so why was I getting hit with over 1,400,000 request a day to the web URI and not the API by some bot farm in China the other week. They were also hitting other lemmy instances.
I blocked the fuckers, no qualms at all.
Even if they were using the API they were not being nice about their shit.
original content written with or which facilitates the use of LLMs (large language models) or other generative AI technologies
I feel that this becomes very restrictive.
That was a good read
I have AdGuard Home running on OPNSense as a local DNS with a wild card for for the ‘local domain’ pointing to Caddy
in Caddy I have this section:
*.<domain>.net {
#header X-Frame-Options "SAMEORIGIN"
tls internal
encode gzip
import sec-headers
@sub1 host pve.<domain>.net
@sub2 host kasm.<domain>.net
...
handle @sub1 {
import sec-headers
reverse_proxy * https://10.1.1.11:8006/ {
transport http {
tls_insecure_skip_verify
}
# header_up Host {host}
header_up X-Real-IP {remote}
header_up X-Forwarded-For {remote}
header_up X-Forwarded-Port {server_port}
header_up X-Forwarded-Proto {scheme}
}
}
handle @sub2 {
import sec-headers
reverse_proxy https://10.1.1.119/ {
transport http {
tls_insecure_skip_verify
}
# header_up Host {host}
header_up X-Real-IP {remote}
header_up X-Forwarded-For {remote}
header_up X-Forwarded-Port {server_port}
header_up X-Forwarded-Proto {scheme}
}
}
...
Back up the server then work through:
Just follow the guide https://iocaine.madhouse-project.org/documentation/3/getting-started/ Bind the iocaine service to 0.0.0.0:42069
cat /opt/iocaine/etc/iocaine/config.d/00-server.txt.kdl
http-server default {
bind "0.0.0.0:42069"
use handler-from=default
}
expose interface to Docker (make sure not to expose it to the world).
sudo iptables -I INPUT 4 \
-s 172.18.0.0/16 \
-d 172.18.0.1 \
-p tcp --dport 42069 \
-j ACCEPT
add the interface to the proxy service in a custom/docker-compose.yml.template
proxy:
{{COMPOSE_CADDY_IMAGE}}
env_file:
- ./caddy.env
- {{ CADDY_EXTRA_ENV }}
volumes:
- ./caddy/Caddyfile:/etc/caddy/Caddyfile:ro
- caddy_data:/data
- caddy_config:/config
extra_hosts:
- "host.docker.internal:172.18.0.1"
...
add iocaine to caddy in a custom/Caddyfile.template
{$LEMMY_HOSTNAME} {
import caddy-common
######################################
########## iocaine code ##########
@read method GET HEAD
reverse_proxy @read host.docker.internal:42069 {
@fallback status 421
handle_response @fallback
}
...
rebuild all the docler images (at least the caddy one ./deploy.sh -f) and test
I think that should work
CrowdSec
Well done on getting it up and running, federation seems to be working https://moplemmy.fyi/instances & https://phiresky.github.io/lemmy-federation-state/site?domain=moplemmy.fyi
You shouldn’t have to put instances in the Allowed Instances, just use blocked list for stuff you dont want to see
Yes email is a pain in the arse. More so if you are having to deal with dynamic IPs
Now just wait for the scrapers to turn up. Both Dave (lemmy.nz) and I are getting well in excess of 500k requests from content scrapers per day atm and they are tyring to pull in whole comment trees and walk through all posters.
Have a look at Iocaine to help tarpit some of them if you dont want to route through something like cloudflare.
yes github
those ~2000 blocks were in the hour after turning on the full proxy, still getting a fair few from china hitting the real IP address that they must have cached.
Grep’d the logs and had 250,000 requests from china in the last 20 hours asking for full threads via the api
up untill now I’ve not had too much bot traffic, but I’m betting hammered atm. Make sure to have some good firewall rules for when it happens:
Yes you are mad, I know as I did that over 3 years ago. Went from at home => a cheep VPS => paid for Oracle VPS.
If you go down the lemmy route (vs piefed) then I would deply with Lemmy-Easy-Deploy by @ubergeek77. this makes setting Caddy and mail simple
I hit the same thing on git yesterday, used the “Main” search thing not realizing it was their copilot shit. it took ages to think, then spew out a pile of shit with the links to what I actually wanted buried in a wall of text - how the fuck is that better?
We had the same thought when we went to Norway - they do New Zealand like it should look. But them I’m from the Waikato and the best we can do is a few shit brown rivers
fuck mate, they said as much
Dawarich and Reitti are the two I know of. tested both around a year ago, but not used really since then
I would say start with Samba (or other NAS network FS), then try something like Immch image storage, move on to Jellyfin and a arr stack and then the world is your oyster
A radio interview with one of the authors
One can only hope
/s as I know you wont have full and fair elections next few elections (mid terms and beyond)
This is because, as a simple calculation demonstrates, a case of congenital blindness and schizophrenia would be extremely rare even if there was no protective effect of blindness: if schizophrenia occurs at a rate of 0.72% in the population (McGrath et al., 2008) and congenital blindness occurs at an estimated rate of 0.03% in people born in the 1970s and 1980s (based on Robinson et al., 1987), then the joint probability of a person having both conditions, if the two are independent, would be 0.0002% or 2 out of every 1 million people. Although this is a low prevalence rate, it is equal to or higher than the rates for several other well-known conditions (e.g., Creutzfeldt-Jakob disease, hereditary spastic paraplegia, Hermansky-Pudlak Syndrome). Based on this estimated prevalence rate, in the United States alone (with a population of 311, 591, 917, as of July 2011, according the US census), there should be approximately 620 congenitally blind people with schizophrenia. When cases of blindness with an onset in the first year of life (i.e., early blindness) are taken into account, the percentage would be larger. Therefore, it is remarkable that in over 60 years, and with several investigations [including several before DSM-III (1980) when criteria for schizophrenia were broader than at present], not a single case of a C/E blind schizophrenia patient has been reported.
https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2013.00157/full
One such site, removed,
services to <deleted by BlueÆther> for over a decade.
Remove it once, but not the second time?
Ive got a couple of PLCs that I keep meaning to pull out of old hardware before it gets scrapped for the stainless value.
None of the PLCs that I use at work are networked, and they are getting ridicules in their pricing when safety stuff is now involved