SQL Server Alternatives

Overall. My experience with AWS Glue has been very positive. It is a feature-rich, serverless data integration platform that simplifies building and managing ETL pipelines at scale. The platform is particularly strong in metadata management, data transformation and seamless integration with AWS native services. AWS Glue stands out due to its wide range of connectors, automated schema delivery, and flexible transformation capabilities using spark. While it requires some expertise to fully leverage advanced features like optimization and data modelling, it provides a comprehensive and scalable solution for modern data engineering use cases.

FME is an excellent tool for automating geospatial workflows. I have used it across a variety of projects and it has consistently delivered reliable results. The software makes complex data transformations much more manageable and saves significant time compared to manual processing. Highly recommended for anyone working with geospatial data.

Informatica Powercenter is a good ETL tool. Support extraction, transform and load the data to different targets from heterogeneous sources. It is a very reliable tool for data engineers to load data into data warehouses.

I am not an end-user of Ab Initio and cannot really speak to its capabilities as an ETL tool. I manage the infrastructure that delivers Ab Initio to our end-users so my perspective is only on those aspects which I touch. As far as managing installation and patching and maintaining the software, the processes are a bit legacy. However, one of the projects we're working with our support representatives is modernizing that, so that's definitely on their plates as something they're working on. But that's the main thing that makes Ab Initio so great is the relationship they maintain with us, which has been nothing but phenomenal the entire time I've been on the project and this is echoed by others who have been on the project much longer than me. Ab Initio truly makes us feel like a customer where most other vendors just don't.

Our organization leverages Fivetran to hydrate our BigQuery data lake. Currently, Fivetran is used for incremental data extraction from over 40 SaaS and platform sources, while HVR supports real-time replication of over 400 tables from two database sources, with additional sources currently being onboarded. Fivetran products play a critical role in our data landscape, as data ingestion is the first - and foundational - step in our Data & Analytics lifecycle. If the data is not reliable at this stage, the value of downstream analytics is significantly reduced. After more than 3 years of partnership, our experience with Fivetran has been very positive, and we look forward to continuing to strengthen and expand this collaboration.

The solution is stable, innovative and has a very broad functional coverage. It replaces many components that we would otherwise have had to assemble. The platform's evolution is satisfactory, and the integration of new features happens at a satisfactory pace. The publisher listens to its clients, the support is of very high quality, as are the documentation resources. Additionally, once you become a client, access to online training and certifications is included.

It's a functional platform that gets the job done, but it definitely feels like a "jack of all trades, master of none" situation. On one hand, it's great to have everything in the cloud without managing servers, and the security features are robust enough for our compliance needs. On the other hand, the transition from legacy on-prem solutions to this cloud version hasn't been as seamless as id hoped for. We often find ourselves stuck in the middle with Talend because while, yes, it's more powerful than a basic ingestion tool, it's also more restrictive than a pure code environment. It's a solid 3-star choice for a mid to large company that wants a "safe" enterprise bet, but it lacks the "wow" factor or the agility of some newer, leaner competitors.

When we started using Snowflake in 2018, we chose Matillion ETL as our tool of choice for data integration and orchestration of data pipelines. We are currently in the process of migration. We have been using Matillion as our main data integration and data transformation tool for our Snowflake data warehouse to enable data-driven initiatives in B2C sales and marketing. We have been processing mostly batch data. As our team consists of people with strong programming and data backgrounds as well as less tech-savvy users, Matillion facilitates easy collaboration between the two. The representation of a data pipeline as a flow chart of components with customizable properties on a canvas is easily readable even without a technical background. Some complex SQL usage patterns have no equivalent component in Matillion ELT but can be implemented using an SQL component. Sampling at any step of the data pipeline makes ongoing validation of the data transformation and debugging very easy. Matillion ETL offers connectors to integrate with most data sources relevant to our use cases. Seamless integration of Python in the orchestration jobs, offers the ability for API calls should a native connector to any source system be missing. Rollout on both Azure and AWS was well documented and easily done. In general, Matillion ETL integrates well into our workflow, however the GIT integration is lacking some features to make it truly elegant, especially for users who are less used to it. We onboarded other teams on Snowflake and Matillion ELT who were quickly able to work independently after an early short period of enablement and support. In total, our Matillion ETL instance hosted 15-20 data engineers across several teams. As we did not have a data warehouse beforehand, we cannot supply comparative metrics. Snowflake and Matillion outright enabled us for the first time to conduct truly data-driven use cases with state of the art technology solutions.