- Add your QDS_AUTH_TOKEN in rubix_stressor.py
- Add fact tables' DDLs in fact_tables.sql
- Add/Update dimension tables' DDLs in dimensions.sql
(Works on api.qubole right now)
- Run fact_tables.sql via Hive in your account
- Run dimensions.sql via Hive in your account
- Start a Presto cluster labelled "rubix-stress" with aggressive downscaling and size appropriate to test disk space based evictions
- Change API_TOKEN as needed
- Run
python rubix_stressor.py 2>&1 | tee logs
using python3 - Ctrl-C to exit gracefully when done
- Grep "failed" in
logs