Tushyraw240702janewildetinyfireextra Quality Crackerj

If "tushyraw240702janewildetinyfireextra quality crackerj" was a typo or a miscommunication, and you have a real topic in mind, please provide it. I'd be more than happy to help you:

Example command-line:

sha256sum tushyraw_*.csv > docs/checksums.txt
file tushyraw_*.csv
iconv -f ISO-8859-1 -t UTF-8 -o fixed.csv tushyraw_*.csv

Tools: Great Expectations, pandera, or custom scripts.

Example:

pip install pyarrow
df.to_parquet("data/processed/tushyraw_2024-07-02_v1.parquet")

Commands (example):

head -n 100 file.csv
tail -n 100 file.csv
csvstat file.csv   # from csvkit

If you want, I can:

Which of those should I create next?