How to Profile Python Code, With an Aside on Parallelism
I recently wrote a script that reads thousands of files of tweets, transforms them, and spits out “only” hundreds of files. Having tested the script on my computer on a few files, I was surprised to find the execution taking much longer than anticipated on my server, especially since the server’s CPUs are more powerful […]