Mastodon 🐘

InfoQShifting Left isn’t just a buzzword - it’s the foundation for efficiency in your organization!By making clean, reliable, and accessible data available across your organization, you reduce complexity and unlock time to focus on higher-value work.💡 Data products are the foundation of this <a href="https://techhub.social/tags/ShiftLeft" class="mention hashtag" rel="nofollow noopener" target="_blank">#ShiftLeft</a>, enabling healthy, scalable data communication.📖 Dive into the details in the <a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener" target="_blank">#InfoQ</a> article: <a href="https://bit.ly/3WHjxsf" rel="nofollow noopener" translate="no" target="_blank">https://bit.ly/3WHjxsf</a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareArchitecture</a> <a href="https://techhub.social/tags/DataMesh" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataMesh</a> <a href="https://techhub.social/tags/DataLake" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataLake</a> <a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataPipelines</a> <a href="https://techhub.social/tags/ETL" class="mention hashtag" rel="nofollow noopener" target="_blank">#ETL</a>

InfoQAtlassian introduced Lithium - an in-house <a href="https://techhub.social/tags/ETL" class="mention hashtag" rel="nofollow noopener" target="_blank">#ETL</a> platform designed to meet the requirements of dynamic data movement.Lithium simplifies cloud migrations, scheduled backups, and in-flight data validations with ephemeral pipelines and tenant-level isolation - ensuring efficiency, scalability & cost savings.📢 InfoQ spoke with Niraj Mishra, Principal Engineer at Atlassian, about Lithium’s implementation and future.🔗 Read more here: <a href="https://bit.ly/415RPYZ" rel="nofollow noopener" translate="no" target="_blank">https://bit.ly/415RPYZ</a><a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataPipelines</a> <a href="https://techhub.social/tags/KafkaStreams" class="mention hashtag" rel="nofollow noopener" target="_blank">#KafkaStreams</a> <a href="https://techhub.social/tags/ApacheKafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#ApacheKafka</a> <a href="https://techhub.social/tags/ApacheFlink" class="mention hashtag" rel="nofollow noopener" target="_blank">#ApacheFlink</a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareArchitecture</a><a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener" target="_blank">#InfoQ</a>

InfoQA <a href="https://techhub.social/tags/ShiftLeft" class="mention hashtag" rel="nofollow noopener" target="_blank">#ShiftLeft</a> approach to <a href="https://techhub.social/tags/DataProcessing" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataProcessing</a> relies on data products, which form the basis of data communication across the business.This addresses many flaws in traditional data processing and makes data more relevant, complete, and trustworthy.<a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener" target="_blank">#InfoQ</a> article: <a href="https://bit.ly/3WHjxsf" rel="nofollow noopener" translate="no" target="_blank">https://bit.ly/3WHjxsf</a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareArchitecture</a> <a href="https://techhub.social/tags/DataMesh" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataMesh</a> <a href="https://techhub.social/tags/DataLake" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataLake</a> <a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataPipelines</a> <a href="https://techhub.social/tags/ETL" class="mention hashtag" rel="nofollow noopener" target="_blank">#ETL</a>

LavX NewsWelcome to the Data Engineering Circus: A Tale of Chaos and CreativityStepping into the world of data engineering often feels like entering a chaotic circus, where pipelines are more like Rube Goldberg machines than the sleek systems promised during the interview. From ...<a href="https://news.lavx.hu/article/welcome-to-the-data-engineering-circus-a-tale-of-chaos-and-creativity" rel="nofollow noopener" translate="no" target="_blank">https://news.lavx.hu/article/welcome-to-the-data-engineering-circus-a-tale-of-chaos-and-creativity</a><a href="https://mastodon.social/tags/news" class="mention hashtag" rel="nofollow noopener" target="_blank">#news</a> <a href="https://mastodon.social/tags/tech" class="mention hashtag" rel="nofollow noopener" target="_blank">#tech</a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataEngineering</a> <a href="https://mastodon.social/tags/ETLChaos" class="mention hashtag" rel="nofollow noopener" target="_blank">#ETLChaos</a> <a href="https://mastodon.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataPipelines</a>

aijobs.netHIRING: Senior Data Scientist / Remote (anywhere in the U.S.) 💰 USD 120K+👉 <a href="https://aijobs.net/J761697/" target="_blank" rel="nofollow noopener" translate="no">https://aijobs.net/J761697/</a><a href="https://mstdn.social/tags/ComputerScience" class="mention hashtag" rel="tag">#ComputerScience</a> <a href="https://mstdn.social/tags/Dagster" class="mention hashtag" rel="tag">#Dagster</a> <a href="https://mstdn.social/tags/Datapipelines" class="mention hashtag" rel="tag">#Datapipelines</a> <a href="https://mstdn.social/tags/Datavisualization" class="mention hashtag" rel="tag">#Datavisualization</a> <a href="https://mstdn.social/tags/dbt" class="mention hashtag" rel="tag">#dbt</a> <a href="https://mstdn.social/tags/Economics" class="mention hashtag" rel="tag">#Economics</a> <a href="https://mstdn.social/tags/Engineering" class="mention hashtag" rel="tag">#Engineering</a> <a href="https://mstdn.social/tags/Git" class="mention hashtag" rel="tag">#Git</a> <a href="https://mstdn.social/tags/MachineLearning" class="mention hashtag" rel="tag">#MachineLearning</a> <a href="https://mstdn.social/tags/Mathematics" class="mention hashtag" rel="tag">#Mathematics</a>

aijobs.netHIRING: Data Engineer / Remote (anywhere in the U.S.) 💰 USD 100K+👉 <a href="https://aijobs.net/J761696/" target="_blank" rel="nofollow noopener" translate="no">https://aijobs.net/J761696/</a><a href="https://mstdn.social/tags/Airflow" class="mention hashtag" rel="tag">#Airflow</a> <a href="https://mstdn.social/tags/AWS" class="mention hashtag" rel="tag">#AWS</a> <a href="https://mstdn.social/tags/CICD" class="mention hashtag" rel="tag">#CICD</a> <a href="https://mstdn.social/tags/ComputerScience" class="mention hashtag" rel="tag">#ComputerScience</a> <a href="https://mstdn.social/tags/Dagster" class="mention hashtag" rel="tag">#Dagster</a> <a href="https://mstdn.social/tags/Datapipelines" class="mention hashtag" rel="tag">#Datapipelines</a> <a href="https://mstdn.social/tags/dbt" class="mention hashtag" rel="tag">#dbt</a> <a href="https://mstdn.social/tags/Docker" class="mention hashtag" rel="tag">#Docker</a> <a href="https://mstdn.social/tags/ELT" class="mention hashtag" rel="tag">#ELT</a> <a href="https://mstdn.social/tags/Engineering" class="mention hashtag" rel="tag">#Engineering</a>

VicIn today’s <a href="https://techhub.social/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#data</a>-driven world, having <a href="https://techhub.social/tags/inhouse" class="mention hashtag" rel="nofollow noopener" target="_blank">#inhouse</a>, <a href="https://techhub.social/tags/outsourced" class="mention hashtag" rel="nofollow noopener" target="_blank">#outsourced</a>, or <a href="https://techhub.social/tags/dedicated" class="mention hashtag" rel="nofollow noopener" target="_blank">#dedicated</a> data specialists is crucial for making informed business decisions. Whether you need an in-house team or an outsourced data engineering service, skilled professionals ensure that your business can collect, process, and extract valuable insights from data, enabling better decision-making, operational efficiency, and competitive advantage. Info: <a href="https://www.ibm.com/think/topics/data-engineering" rel="nofollow noopener" translate="no" target="_blank">https://www.ibm.com/think/topics/data-engineering</a><a href="https://techhub.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a> <a href="https://techhub.social/tags/etl" class="mention hashtag" rel="nofollow noopener" target="_blank">#etl</a> <a href="https://techhub.social/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a> <a href="https://techhub.social/tags/bigdata" class="mention hashtag" rel="nofollow noopener" target="_blank">#bigdata</a> <a href="https://techhub.social/tags/datainfrastructure" class="mention hashtag" rel="nofollow noopener" target="_blank">#datainfrastructure</a> <a href="https://techhub.social/tags/dataintegration" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataintegration</a> <a href="https://techhub.social/tags/dataquality" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataquality</a> <a href="https://techhub.social/tags/cloudcomputing" class="mention hashtag" rel="nofollow noopener" target="_blank">#cloudcomputing</a> <a href="https://techhub.social/tags/aws" class="mention hashtag" rel="nofollow noopener" target="_blank">#aws</a> <a href="https://techhub.social/tags/googlecloud" class="mention hashtag" rel="nofollow noopener" target="_blank">#googlecloud</a> <a href="https://techhub.social/tags/azure" class="mention hashtag" rel="nofollow noopener" target="_blank">#azure</a> <a href="https://techhub.social/tags/datagovernance" class="mention hashtag" rel="nofollow noopener" target="_blank">#datagovernance</a> <a href="https://techhub.social/tags/automation" class="mention hashtag" rel="nofollow noopener" target="_blank">#automation</a> <a href="https://techhub.social/tags/datatools" class="mention hashtag" rel="nofollow noopener" target="_blank">#datatools</a> <a href="https://techhub.social/tags/etltools" class="mention hashtag" rel="nofollow noopener" target="_blank">#etltools</a> <a href="https://techhub.social/tags/nosql" class="mention hashtag" rel="nofollow noopener" target="_blank">#nosql</a> <a href="https://techhub.social/tags/datastorage" class="mention hashtag" rel="nofollow noopener" target="_blank">#datastorage</a> <a href="https://techhub.social/tags/datatransformation" class="mention hashtag" rel="nofollow noopener" target="_blank">#datatransformation</a> <a href="https://techhub.social/tags/hadoop" class="mention hashtag" rel="nofollow noopener" target="_blank">#hadoop</a> <a href="https://techhub.social/tags/spark" class="mention hashtag" rel="nofollow noopener" target="_blank">#spark</a> <a href="https://techhub.social/tags/kafka" class="mention hashtag" rel="nofollow noopener" target="_blank">#kafka</a> <a href="https://techhub.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#machinelearning</a> <a href="https://techhub.social/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://techhub.social/tags/datascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#datascience</a> <a href="https://techhub.social/tags/datadriven" class="mention hashtag" rel="nofollow noopener" target="_blank">#datadriven</a> <a href="https://techhub.social/tags/businessintelligence" class="mention hashtag" rel="nofollow noopener" target="_blank">#businessintelligence</a> <a href="https://techhub.social/tags/techinnovation" class="mention hashtag" rel="nofollow noopener" target="_blank">#techinnovation</a> <a href="https://techhub.social/tags/predictiveanalytics" class="mention hashtag" rel="nofollow noopener" target="_blank">#predictiveanalytics</a> <a href="https://techhub.social/tags/dataanalysis" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataanalysis</a> <a href="https://techhub.social/tags/datawarehouse" class="mention hashtag" rel="nofollow noopener" target="_blank">#datawarehouse</a> <a href="https://techhub.social/tags/clouddata" class="mention hashtag" rel="nofollow noopener" target="_blank">#clouddata</a> <a href="https://techhub.social/tags/businessdecisions" class="mention hashtag" rel="nofollow noopener" target="_blank">#businessdecisions</a>

KedroIn the pipeline: July 2024 edition! 🔶This month we review the latest releases across the Kedro ecosystem, celebrate the PyData London workshop delivered by two TSC members, and much more.Will you be at EuroPython in Prague next week? Don't miss Juan Luis' workshop about MLOps! (And follow <a href="https://fosstodon.org/@europython" class="u-url mention" rel="nofollow noopener" target="_blank">@europython</a>)Full blog post:<a href="https://kedro.org/blog/in-the-pipeline-kedro-news-07-24" rel="nofollow noopener" translate="no" target="_blank">https://kedro.org/blog/in-the-pipeline-kedro-news-07-24</a><a href="https://social.lfx.dev/tags/kedro" class="mention hashtag" rel="nofollow noopener" target="_blank">#kedro</a> <a href="https://social.lfx.dev/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#python</a> <a href="https://social.lfx.dev/tags/pydata" class="mention hashtag" rel="nofollow noopener" target="_blank">#pydata</a> <a href="https://social.lfx.dev/tags/datascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#datascience</a> <a href="https://social.lfx.dev/tags/mlops" class="mention hashtag" rel="nofollow noopener" target="_blank">#mlops</a> <a href="https://social.lfx.dev/tags/kedroviz" class="mention hashtag" rel="nofollow noopener" target="_blank">#kedroviz</a> <a href="https://social.lfx.dev/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a> <a href="https://social.lfx.dev/tags/europython" class="mention hashtag" rel="nofollow noopener" target="_blank">#europython</a> <a href="https://social.lfx.dev/tags/EuroPython2024" class="mention hashtag" rel="nofollow noopener" target="_blank">#EuroPython2024</a>

KedroIn the pipeline: May 2024 edition! 🔶This month we published several releases across the Kedro ecosystem, got featured in O'Reilly's new book "Software Engineering for Data Scientists", published more videos in our YouTube channel, and got accepted at several Python conferences.Are you at <a href="https://fosstodon.org/@pycon" class="u-url mention" rel="nofollow noopener" target="_blank">@pycon</a>? Don't miss Juliana Ferreira's talk about Kedro!Full blog post:<a href="https://kedro.org/blog/in-the-pipeline-kedro-news-05-24" rel="nofollow noopener" translate="no" target="_blank">https://kedro.org/blog/in-the-pipeline-kedro-news-05-24</a><a href="https://social.lfx.dev/tags/kedro" class="mention hashtag" rel="nofollow noopener" target="_blank">#kedro</a> <a href="https://social.lfx.dev/tags/python" class="mention hashtag" rel="nofollow noopener" target="_blank">#python</a> <a href="https://social.lfx.dev/tags/pydata" class="mention hashtag" rel="nofollow noopener" target="_blank">#pydata</a> <a href="https://social.lfx.dev/tags/datascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#datascience</a> <a href="https://social.lfx.dev/tags/mlops" class="mention hashtag" rel="nofollow noopener" target="_blank">#mlops</a> <a href="https://social.lfx.dev/tags/kedroviz" class="mention hashtag" rel="nofollow noopener" target="_blank">#kedroviz</a> <a href="https://social.lfx.dev/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a>

InfoQ<a href="https://techhub.social/tags/CaseStudy" class="mention hashtag" rel="nofollow noopener" target="_blank">#CaseStudy</a> - Discover how <a href="https://techhub.social/tags/Yelp" class="mention hashtag" rel="nofollow noopener" target="_blank">#Yelp</a> reworked its data streaming architecture with <a href="https://techhub.social/tags/ApacheBeam" class="mention hashtag" rel="nofollow noopener" target="_blank">#ApacheBeam</a> & <a href="https://techhub.social/tags/ApacheFlink" class="mention hashtag" rel="nofollow noopener" target="_blank">#ApacheFlink</a>!The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.Dive into the details: <a href="https://bit.ly/3WgkTL7" rel="nofollow noopener" translate="no" target="_blank">https://bit.ly/3WgkTL7</a> <a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener" target="_blank">#InfoQ</a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareArchitecture</a> <a href="https://techhub.social/tags/EventDrivenArchitecture" class="mention hashtag" rel="nofollow noopener" target="_blank">#EventDrivenArchitecture</a> <a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataPipelines</a> <a href="https://techhub.social/tags/Streaming" class="mention hashtag" rel="nofollow noopener" target="_blank">#Streaming</a>

Matt AslettNew Ventana Research Analyst Perspective: Data Pipelines Integrate Data Processing and Enable AI <a href="https://mattaslett.ventanaresearch.com/data-pipelines-integrate-data-processing-and-enable-ai" rel="nofollow noopener" target="_blank">https://mattaslett.ventanaresearch.com/data-pipelines-integrate-data-processing-and-enable-ai</a> The development, testing and deployment of <a href="https://mastodon.cloud/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a> is a fundamental accelerator of data-driven strategies

DagsterWe have added another entry to the <a href="https://data-folks.masto.host/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a> glossary:Distributed systems let data engineers process data at scale but also introduce a raft of new complexities and considerations. Linearizability ensures that operations maintain a logical order of execution. Learn more with a Python example here: <a href="https://dagster.io/glossary/linearizability" rel="nofollow noopener" translate="no" target="_blank">https://dagster.io/glossary/linearizability</a><a href="https://data-folks.masto.host/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a>

DagsterIt's been interesting watching many larger enterprises build DSLs—Domain Specific Languages—on top of their orchestration solution. By implementing DSLs, data teams can open their data platform to many more users without compromizing on standards.We wrote this up in a blog post to share the insights and approaches.<a href="https://dagster.io/blog/scale-and-standardize-data-pipelines-with-dsl" rel="nofollow noopener" translate="no" target="_blank">https://dagster.io/blog/scale-and-standardize-data-pipelines-with-dsl</a><a href="https://data-folks.masto.host/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#data</a> <a href="https://data-folks.masto.host/tags/dataengineering" class="mention hashtag" rel="nofollow noopener" target="_blank">#dataengineering</a> <a href="https://data-folks.masto.host/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a>

InfoQExplore <a href="https://techhub.social/tags/QuixStreams" class="mention hashtag" rel="nofollow noopener" target="_blank">#QuixStreams</a> - an <a href="https://techhub.social/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource</a> <a href="https://techhub.social/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#Python</a> library that makes it easy for engineers to build real-time ML pipelines without having to learn the intricacies of building a streaming application from scratch.Learn more about the magic behind it: <a href="https://bit.ly/483oT3U" rel="nofollow noopener" translate="no" target="_blank">https://bit.ly/483oT3U</a> This <a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener" target="_blank">#InfoQ</a> talk is relevant for data scientists, ML engineers, and software engineers who are looking to adopt new technologies and practices to build real-time ML pipelines and stay current in their field.<a href="https://techhub.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a> <a href="https://techhub.social/tags/ML" class="mention hashtag" rel="nofollow noopener" target="_blank">#ML</a> <a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataPipelines</a>

aijobs.netHIRING: Data Engineer / Garching near Munich👉 <a href="https://ai-jobs.net/J123755/" target="_blank" rel="nofollow noopener" translate="no">https://ai-jobs.net/J123755/</a><a href="https://mstdn.social/tags/AI" class="mention hashtag" rel="tag">#AI</a> <a href="https://mstdn.social/tags/Python" class="mention hashtag" rel="tag">#Python</a> <a href="https://mstdn.social/tags/DataJobs" class="mention hashtag" rel="tag">#DataJobs</a> <a href="https://mstdn.social/tags/Jobsearch" class="mention hashtag" rel="tag">#Jobsearch</a> <a href="https://mstdn.social/tags/MLjobs" class="mention hashtag" rel="tag">#MLjobs</a> <a href="https://mstdn.social/tags/bigdata" class="mention hashtag" rel="tag">#bigdata</a> <a href="https://mstdn.social/tags/DataScience" class="mention hashtag" rel="tag">#DataScience</a> <a href="https://mstdn.social/tags/AIjobs" class="mention hashtag" rel="tag">#AIjobs</a> <a href="https://mstdn.social/tags/techjobs" class="mention hashtag" rel="tag">#techjobs</a> <a href="https://mstdn.social/tags/hiring" class="mention hashtag" rel="tag">#hiring</a> <a href="https://mstdn.social/tags/DataEngineer" class="mention hashtag" rel="tag">#DataEngineer</a> <a href="https://mstdn.social/tags/Munich" class="mention hashtag" rel="tag">#Munich</a> <a href="https://mstdn.social/tags/DEjobs" class="mention hashtag" rel="tag">#DEjobs</a> <a href="https://mstdn.social/tags/DataManagement" class="mention hashtag" rel="tag">#DataManagement</a> <a href="https://mstdn.social/tags/ETLjobs" class="mention hashtag" rel="tag">#ETLjobs</a> <a href="https://mstdn.social/tags/datapipelines" class="mention hashtag" rel="tag">#datapipelines</a> <a href="https://mstdn.social/tags/NoSQL" class="mention hashtag" rel="tag">#NoSQL</a>

InfoQ<a href="https://techhub.social/tags/Netflix" class="mention hashtag" rel="nofollow noopener" target="_blank">#Netflix</a> created a new solution for incremental processing in its data platform, reducing computing costs and execution time.Learn how Maestro <a href="https://techhub.social/tags/WorkflowEngine" class="mention hashtag" rel="nofollow noopener" target="_blank">#WorkflowEngine</a> & <a href="https://techhub.social/tags/ApacheIceberg" class="mention hashtag" rel="nofollow noopener" target="_blank">#ApacheIceberg</a> improve data freshness and accuracy: <a href="https://bit.ly/47G53vo" rel="nofollow noopener" translate="no" target="_blank">https://bit.ly/47G53vo</a> <a href="https://techhub.social/tags/InfoQ" class="mention hashtag" rel="nofollow noopener" target="_blank">#InfoQ</a> <a href="https://techhub.social/tags/SoftwareArchitecture" class="mention hashtag" rel="nofollow noopener" target="_blank">#SoftwareArchitecture</a> <a href="https://techhub.social/tags/Database" class="mention hashtag" rel="nofollow noopener" target="_blank">#Database</a> <a href="https://techhub.social/tags/DataPipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#DataPipelines</a> <a href="https://techhub.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a> <a href="https://techhub.social/tags/ML" class="mention hashtag" rel="nofollow noopener" target="_blank">#ML</a>

Juan LuisToday's random thought: thinking about <a href="https://social.lfx.dev/@kedro" class="u-url mention" rel="nofollow noopener" target="_blank">@kedro</a> for ETL pipelines, the Singer ecosystem, Polars dataframes, Voltron's Codex, data contracts...Is there even a standard for _data schemas_? I've seen Singer schemas, SQL `CREATE` statements, JSON Schema, and possibly more.<a href="https://social.juanlu.space/tags/data" class="mention hashtag" rel="nofollow noopener" target="_blank">#data</a> <a href="https://social.juanlu.space/tags/etl" class="mention hashtag" rel="nofollow noopener" target="_blank">#etl</a> <a href="https://social.juanlu.space/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a>

\๏/eg'Gratuliere' to the participants and organizers of the <a href="https://fosstodon.org/tags/OpenData" class="mention hashtag" rel="nofollow noopener" target="_blank">#OpenData</a> hackathon in St.Gallen this weekend with <a href="https://mastodon.social/@OpendataCH" class="u-url mention" rel="nofollow noopener" target="_blank">@OpendataCH</a> <a href="https://fosstodon.org/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#machinelearning</a> <a href="https://fosstodon.org/tags/uxdesign" class="mention hashtag" rel="nofollow noopener" target="_blank">#uxdesign</a> <a href="https://fosstodon.org/tags/datapipelines" class="mention hashtag" rel="nofollow noopener" target="_blank">#datapipelines</a> <a href="https://opendatahacksg.vercel.app/?&headline=1&hexagons=1&sort=score" rel="nofollow noopener" translate="no" target="_blank">https://opendatahacksg.vercel.app/?&headline=1&hexagons=1&sort=score</a>

Recent searches

Search options

Administered by:

Server stats:

#datapipelines