Yle Data Integration and Transformation Solutions
Data Integration and Transformation Solution, use case A
The sought solutions should ingest data from source systems into the Snowflake data warehouse, run and orchestrate in-warehouse transformation jobs that replace the current scope of the ETL solution, including the migration of the existing pipelines. The goal is to find solution(s) that can take over the roles of ingestion and data transformations and their orchestration that the current ETL solution covers, and build a reliable, maintainable data foundation supporting analytics, reporting and AI/ML use cases across the organisation.
Data Integration and Transformation Solution, use case B
The sought solution should include a cloud-based tool for in-warehouse transformations and transformation job orchestration, and have capabilities or a separate reverse-ETL solution that can push selected data from the Snowflake data warehouse to downstream business systems. The target architecture assumes raw event and API data reach the warehouse via a dedicated streaming collection tool and event-driven custom API integrations, so any data ingestion capabilities are considered optional.