Articles by Python - datawookie

Avoiding Duplication

October 10, 2024 | Python - datawookie

Avoiding data duplication is a persistent challenge with acquiring data from websites or APIs. You can try to brute force it: pull the data again and then compare it locally to establish whether it’s fresh or stale. But there are other approaches that, if supported, can make this a ... [...Read more...]

Economic Calendar

October 2, 2024 | Python - datawookie

I needed an offline copy of an economic calendar with all of the major international economic events. After grubbing around the internet I found the Economic Calendar on Myfxbook which had everything that I needed.
[...Read more...]

Bypassing Cloudflare with Cloudscraper

July 20, 2024 | Python - datawookie

Cloudflare is a service that aims improve the performance and security of websites. It operates as a content delivery network (CDN) to ensure faster load times and consequently better user experience. However, it also protects against online threats by filtering “malicious” traffic. Web scraping requests are often deemed to be ...
[...Read more...]

Unpacking cURL Commands

July 10, 2024 | Python - datawookie

cURL is the ultimate Swiss Army Knife for interacting with network protocols. But to be honest, I really only scratch the surface of what’s possible. Usually my workflow is something like this: Copy a cURL command from my browser’s Developer Tools. Test out the cURL command in a ...
[...Read more...]

Desert Island Docker: Python Edition

May 14, 2024 | Python - datawookie

Over the years that I’ve been dabbling in public speaking I’ve generally developed a talk, presented it once and then moved on. However, I’ve noticed other speakers who give the same (or similar) talk at different events, where the talk evolves and improves over time. [...Read more...]

Logging like a Lumberjack

April 18, 2024 | Python - datawookie

Sprinkling status messages across you code using print() statements can be a good temporary fix for tracking down issues in your code. But it can get messy and there’s no way for you to selectively disable them. Sure you can redirect output to a file or /dev/null but ... [...Read more...]
1 2 3