Articles by Python - datawookie

Logging like a Lumberjack

April 18, 2024 | Python - datawookie

Sprinkling status messages across you code using print() statements can be a good temporary fix for tracking down issues in your code. But it can get messy and there’s no way for you to selectively disable them. Sure you can redirect output to a file or /dev/null but ... [...Read more...]

Python Security Audit

January 23, 2024 | Python - datawookie

Is my code secure? This is something that we should all be thinking (if not worrying) about. A thorough security audit would be the ideal, but what if you don’t have the skills or resources for that? Well, there are some tools that will at least get you part ... [...Read more...]

Cookies & Headers from Selenium

November 7, 2023 | Python - datawookie

One of my standard approaches to scraping content from a dynamic website is to diagnose the API behind the site and then use it to retrieve data directly. This means that I can make efficient HTTP requests using the requests package and I don’t need to worry about all ...
[...Read more...]

Cookies & Headers from Selenium

October 31, 2023 | Python - datawookie

One of my standard approaches to scraping content from a dynamic website is to diagnose the API behind the site and then use it to retrieve data directly. This means that I can make efficient HTTP requests using the requests package and I don’t need to worry about all ...
[...Read more...]

Undetected ChromeDriver: Stay Below the Radar

October 26, 2022 | Python - datawookie

There’s one major problem with ChromeDriver: anti-bot services are able to detect that a browser session is being automated (as opposed to being used by a regular meat sack) and will often impose restrictions or deny connections altogether. The Undetected ChromeDriver (undetected-chromedriver) Python package is a patched version of ...
[...Read more...]
1 2