Overwrite robots.txt with CloudFlare workers

CloudFlare workers handle http requests & overwrite responses on the fly. Use it to overwrite robots.txt file to prevent crawlers on your self-hosted instances
internet tips and tricks
Google Chrome Developer tools has a handy developer tool feature that you can use to simulate internet speed lower than your normal capacity. This is useful to test requests that are sent to the server from the app but without…