MotherDuck Corp., the maker of a cloud-native data warehouse based on the open-source DuckDB analytical engine, is betting ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Birgitta Böckeler, Distinguished Engineer at ...

Apache Airflow is a great data pipeline as code, but having most of its contributors work for Astronomer is another example of a problem with open source. Depending on your politics, trickle-down ...

Overview:  Open-source big data tools help businesses handle large amounts of information faster and more efficiently.Popular ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Dany Lepage discusses the architectural ...

Embedding pipelines are fundamentally a data engineering problem, not an entirely new AI discipline. It’s still ETL (Extract, ...

SAN FRANCISCO, June 3, 2026 /PRNewswire/ -- dltHub, the company behind the open-source Python library dlt and the agentic ...

Using workarounds to pipe data between systems carries a high price and untrustworthy data. Bharath Chari shares three possible solutions backed up by real use cases to get data streaming pipelines ...

Organizations today flourish or fade by data. As market research, product development and service delivery all go digital, the role of data grows to constitute the entire business, as it already does ...

In the modern enterprise, data isn’t just a byproduct of systems—it’s the lifeblood of decisions, automation and innovation. Yet, as organizations accelerate their data ambitions, one truth becomes ...