3 Commits

Author	SHA1	Message	Date
Karl-Aksel Puulmann	c8d6b2225f	feat(sharding): add command to sync tables onto new nodes (#8912) ... * feat(sharding): add command to sync tables onto new nodes clickhouse-operator only syncs some tables onto new nodes. This new command ensures that when adding new shards, they are automatically synced up on redeploying Note that there might be timing concerns here as resharding on altinity cloud does not redeploy automatically. In practice however what this means is that new nodes just won't ingest any data until another deploy * Add test to the new command * Improve non-replicated test	2022-03-08 12:50:49 +02:00
Yakko Majuri	3f85aa4c47	special migration -> async migration (#7686) ... * special migration -> async migration * rename frontend dir * format * rename SPECIAL_MIGRATION	2021-12-14 11:48:51 -03:00
Yakko Majuri	b56b141126	Special Migrations Runner (#7054 pt. 4) (#7446) ... * add special migration definition and example * types * special migrations runner * fix tests * fix tests 2 * add clickhouse runner * add temp fix for tests * wip * add special migrations api (#7448) * wip new structure * update example sourcing * Update .gitignore * yet another wip structure * code quality * cypress * test docker image build * implement resumable ops * code quality * add comments * add warning * add conditional requirements for migration * add comment on is_required * add dependency map * wip dependencies and run migration on startup * code quality * fix bugs * fix more bugs * format * types * remove api from this branch * types * types * update clickhouse script * add is_migration_in_range util * fix type * fix runner * add AUTO_START_SPECIAL_MIGRATIONS env var * reset migration on start * cleanup * wip per op rollback * prevent accidental status rollback * add utils and definition test * update example with rollback per op * wip test special migration * add first runner tests * add runner tests * add util for code paths * fix test * fix types * fix types again * cleanup * cleanup * add periodic healthcheck task tests * remove unused imports * safer row updates * fix coalescing none checks * code quality * add docstrings * fix * fix deploys issue * update scripts * add delay * address reviews * address review comments * address review comments * address final comments * fix import error * fix tests * remove unused imports * fix tests * fix task test * remove unused return value * remove unused special migrations code from migrate_clickhouse * tweaks to support fresh deployments	2021-12-13 13:00:27 -03:00