Skip to content

Dev/mip 509 test data

Kostas FILIPPOPOLITIS requested to merge dev/MIP-509-test-data into master

Created by: ThanKarab

Changelog:

  • Each dataset was split into 10 datasets and each dataset is in a separate csv. Jira
  • inv load-data dev script command now loads the csvs into the nodes with round robin fashion.
  • minimum_row_count was added in the .deployment.toml.
  • All tests were updated to work with the new datasets.
  • Algorithm validation tests are now separate tests, not in the production env. They run in development environment on one and five nodes.
  • Production tests now run on 3 nodes and include only 5 of the algorithm validation tests, per algorithm.
  • Rabbitmq image version upgraded and management plugin enabled, for monitoring.
  • Quart version upgraded.
  • Celery queue is now using pyamqp instead of amqp.
  • Controller celery fixes, broker_connection() was never closed after opening.
  • Added dev env and prod env logs before and after the tests to know what went wrong.

Merge request reports