Mastodon 🐘

8 posts8 participants1 post today

Esk 🐌⚡💜howdy, <a href="https://hachyderm.io/tags/hachyderm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hachyderm</a>!over the last week or so, we've been preparing to move hachy's <a href="https://hachyderm.io/tags/DNS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DNS</a> zones from <a href="https://hachyderm.io/tags/AWS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AWS</a> route 53 to bunny DNS.since this could be a pretty scary thing -- going from one geo-DNS provider to another -- we want to make sure *before* we move that records are resolving in a reasonable way across the globe.to help us to do this, we've started a small, lightweight tool that we can deploy to a provider like bunny's magic containers to quickly get DNS resolution info from multiple geographic regions quickly. we then write this data to a backend S3 bucket, at which point we can use a tool like <a href="https://hachyderm.io/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> to analyze the results and find records we need to tweak to improve performance. all *before* we make the change.then, after we've flipped the switch and while DNS is propagating -- :blobfoxscared: -- we can watch in real-time as different servers begin flipping over to the new provider.we named the tool hachyboop and it's available publicly --> <a href="https://github.com/hachyderm/hachyboop" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/hachyderm/hachyboop</a>please keep in mind that it's early in the booper's life, and there's a lot we can do, including cleaning up my hacky code. :blobfoxlaughsweat: attached is an example of a quick run across 17 regions for a few minutes. the data is spread across multiple files but duckdb makes it quite easy for us to query everything like it's one table.<a href="https://hachyderm.io/tags/sre" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sre</a> <a href="https://hachyderm.io/tags/devops" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#devops</a> <a href="https://hachyderm.io/tags/mastodon" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mastodon</a> <a href="https://hachyderm.io/tags/infrastructure" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#infrastructure</a>

James C :python:In the end, I round-tripped it through DuckDB. I've always loved their super simple table output - nice type information on each column too.This gave me the vertical division I needed between those datestamps. 😅 <a href="https://a2mi.social/@samfirke" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@samfirke</a> <a href="https://mastodon.social/@hugovk" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@hugovk</a> <a href="https://fosstodon.org/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a>

Tatu LeppämäkiThank you to <a href="https://mstdn.social/tags/Kone" class="mention hashtag" rel="tag">#Kone</a> & Mai and Tor Nessling Foundations for supporting this work. A quantitative work like this would not be possible without a robust suite of FOSS tools. My thanks to the maintainers of <a href="https://mstdn.social/tags/QGIS" class="mention hashtag" rel="tag">#QGIS</a>, <a href="https://mstdn.social/tags/pandas" class="mention hashtag" rel="tag">#pandas</a>, <a href="https://mstdn.social/tags/geopandas" class="mention hashtag" rel="tag">#geopandas</a>, <a href="https://mstdn.social/tags/duckdb" class="mention hashtag" rel="tag">#duckdb</a>, <a href="https://mstdn.social/tags/dask" class="mention hashtag" rel="tag">#dask</a>, <a href="https://mstdn.social/tags/statsmodels" class="mention hashtag" rel="tag">#statsmodels</a>, <a href="https://mstdn.social/tags/jupyter" class="mention hashtag" rel="tag">#jupyter</a> and many more!

Johnny Graber<a href="https://mastodon.social/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Python</a> Friday #272: Extensions for <a href="https://mastodon.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a><a href="https://pythonfriday.dev/2025/03/272-extensions-for-duckdb/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://pythonfriday.dev/2025/03/272-extensions-for-duckdb/</a>

Hannes Mühleisen<a href="https://www.timescale.com/blog/benchmarking-databases-for-real-time-analytics-applications" rel="nofollow noopener noreferrer" target="_blank">www.timescale.com/blog/benchma...</a> <a class="hashtag" href="https://bsky.app/search?q=%23duckdb" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> <a href="https://www.timescale.com/blog/benchmarking-databases-for-real-time-analytics-applications" rel="nofollow noopener noreferrer" target="_blank">Not All Analytics Are Equal: B...</a>

Data QuineStreamlining access to tabular datasets stored in Amazon S3 Tables with DuckDB | AWS Storage Blog <a href="https://aws.amazon.com/blogs/storage/streamlining-access-to-tabular-datasets-stored-in-amazon-s3-tables-with-duckdb/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://aws.amazon.com/blogs/storage/streamlining-access-to-tabular-datasets-stored-in-amazon-s3-tables-with-duckdb/</a><a href="https://datasci.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a> <a href="https://datasci.social/tags/AWS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AWS</a> <a href="https://datasci.social/tags/S3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#S3</a> <a href="https://datasci.social/tags/S3Tables" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#S3Tables</a> <a href="https://datasci.social/tags/ApacheIceberg" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ApacheIceberg</a> <a href="https://datasci.social/tags/DataAnalysis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataAnalysis</a>

:rss: DevelopersIOクラスメソッドメンバーズ提供のCURをサクッとコスト分析！(with DuckDB) <a href="https://dev.classmethod.jp/articles/cm-members-mcur-with-duckdb/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://dev.classmethod.jp/articles/cm-members-mcur-with-duckdb/</a><a href="https://rss-mstdn.studiofreesia.com/tags/dev_classmethod" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dev_classmethod</a> <a href="https://rss-mstdn.studiofreesia.com/tags/%E3%82%AF%E3%83%A9%E3%82%B9%E3%83%A1%E3%82%BD%E3%83%83%E3%83%89%E3%83%A1%E3%83%B3%E3%83%90%E3%83%BC%E3%82%BA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#クラスメソッドメンバーズ</a> <a href="https://rss-mstdn.studiofreesia.com/tags/Cost_and_Usage_Report" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cost_and_Usage_Report</a> <a href="https://rss-mstdn.studiofreesia.com/tags/Amazon_S3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Amazon_S3</a> <a href="https://rss-mstdn.studiofreesia.com/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a> <a href="https://rss-mstdn.studiofreesia.com/tags/AWS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AWS</a>

POSETTE: An Event for Postgres💥 Jelte Fennema-Nio (<a href="https://mastodon.social/@jeltef" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@jeltef</a>) returns to <a href="https://mastodon.social/tags/PosetteConf" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PosetteConf</a> in 2025. Watch his talk to learn all about "pg_duckdb: Ducking awesome analytics in <a href="https://mastodon.social/tags/PostgreSQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PostgreSQL</a>" (Livestream 2 on Wed Jun 12th @ 9:00am CEST (UTC+2)) 🦆 🐘 Find out more: <a href="https://posetteconf.com/speakers/jelte-fennema-nio/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://posetteconf.com/speakers/jelte-fennema-nio/</a> <a href="https://mastodon.social/tags/postgres" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#postgres</a> <a href="https://mastodon.social/tags/databases" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#databases</a> <a href="https://mastodon.social/tags/OpenSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenSource</a> <a href="https://mastodon.social/tags/community" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#community</a> <a href="https://mastodon.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a>

osunderdogThe slowest part is traversing NAS file system. Writing all the interesting metadata to a csv. Oh hey, I've got to find distinct paths by same artist, title, album_title. *groan* Well, fine. I need a little <a href="https://dmv.community/tags/database" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#database</a>. Fine, let's expand this learning <a href="https://dmv.community/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a>.

Johnny Graber<a href="https://mastodon.social/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Python</a> Friday #271: Querying Data With <a href="https://mastodon.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a><a href="https://pythonfriday.dev/2025/03/271-querying-data-with-duckdb/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://pythonfriday.dev/2025/03/271-querying-data-with-duckdb/</a>

Ben Companjen 🟥I should have looked at <a href="https://code4lib.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a> before, but with the built-in UI with notebooks (<a href="https://duckdb.org/2025/03/12/duckdb-ui.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://duckdb.org/2025/03/12/duckdb-ui.html</a>) it feels really slick. So note to self: refresh your <a href="https://code4lib.social/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SQL</a> !

Curated Hacker NewsShow HN: GizmoSQL – Run DuckDB as a Server with Arrow Flight SQL<a href="https://github.com/gizmodata/gizmosql-public/blob/main/README.md" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/gizmodata/gizmosql-public/blob/main/README.md</a><a href="https://mastodon.social/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> <a href="https://mastodon.social/tags/github" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#github</a> <a href="https://mastodon.social/tags/sql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sql</a>

Hacker NewsPreview: Amazon S3 Tables and Lakehouse in DuckDB<a href="https://duckdb.org/2025/03/14/preview-amazon-s3-tables.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://duckdb.org/2025/03/14/preview-amazon-s3-tables.html</a><a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HackerNews</a> <a href="https://mastodon.social/tags/Amazon" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Amazon</a> <a href="https://mastodon.social/tags/S3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#S3</a> <a href="https://mastodon.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a> <a href="https://mastodon.social/tags/Lakehouse" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Lakehouse</a> <a href="https://mastodon.social/tags/DataAnalytics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DataAnalytics</a> <a href="https://mastodon.social/tags/CloudComputing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CloudComputing</a> <a href="https://mastodon.social/tags/BigData" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#BigData</a>

Jesus Castagnetto 🇵🇪Quick notes on creating a local <a href="https://mastodon.social/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> helper using <a href="https://mastodon.social/tags/RAG" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#RAG</a> with <a href="https://mastodon.social/tags/aichat" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#aichat</a> and <a href="https://mastodon.social/tags/ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ollama</a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AI</a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a><a href="https://gist.github.com/jmcastagnetto/c83925797241240fb191f9f25da74dbd" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://gist.github.com/jmcastagnetto/c83925797241240fb191f9f25da74dbd</a>

Alex G RiceIn Geodata Ramblings blog, a new post: GIS command-line "gems" for Linux and macOS. Let me know of any other good ones which I should have listed.<a href="https://mapstodon.space/tags/linux" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#linux</a> <a href="https://mapstodon.space/tags/gdal" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gdal</a> <a href="https://mapstodon.space/tags/ogr" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ogr</a> <a href="https://mapstodon.space/tags/cng" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cng</a> <a href="https://mapstodon.space/tags/CNG2025" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CNG2025</a> <a href="https://mapstodon.space/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> <a href="https://mapstodon.space/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> <a href="https://mapstodon.space/tags/postgis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#postgis</a> <a href="https://mapstodon.space/tags/gis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#gis</a> <a href="https://ricegeo.dev/gis-cli-gems/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://ricegeo.dev/gis-cli-gems/</a>

Alejandro BaezVery nice! <a href="https://fosstodon.org/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> has a web ui extension now. I don't always have gigantic queries I'm typing by hand. But when I do, this is going to be so useful to experiment with. 😎 <a href="https://duckdb.org/2025/03/12/duckdb-ui.html" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://duckdb.org/2025/03/12/duckdb-ui.html</a>

:rss: DevelopersIORoute 53 Resolver DNSクエリログ(S3)を DuckDB で分析 <a href="https://dev.classmethod.jp/articles/route-53-resolver-dns-s3-duckdb/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://dev.classmethod.jp/articles/route-53-resolver-dns-s3-duckdb/</a><a href="https://rss-mstdn.studiofreesia.com/tags/dev_classmethod" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dev_classmethod</a> <a href="https://rss-mstdn.studiofreesia.com/tags/Amazon_Route_53" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Amazon_Route_53</a> <a href="https://rss-mstdn.studiofreesia.com/tags/Amazon_VPC" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Amazon_VPC</a> <a href="https://rss-mstdn.studiofreesia.com/tags/Amazon_S3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Amazon_S3</a> <a href="https://rss-mstdn.studiofreesia.com/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a> <a href="https://rss-mstdn.studiofreesia.com/tags/AWS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AWS</a>

Thomas AdamI've been playing around with <a href="https://bsd.network/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> and this fits perfectly.Hence I'm now working on porting this over to <a href="https://bsd.network/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#duckdb</a> as a result.I'm trying to do all of this in <a href="https://bsd.network/tags/sql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sql</a> as much as I can to minimise any post-processing.I've also decided to switch the current page to a <a href="https://bsd.network/tags/hugo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hugo</a> rendered page as wel. I think <a href="https://bsd.network/tags/hugo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#hugo</a> has matured to the point where it supports this use case.At the moment this effort is solo (myself). If anyone wishes to help, please get in touch..l I don't bite! :)

:rss: DevelopersIODuckDBでS3にアクセスする時の認証周りについて確認してみた <a href="https://dev.classmethod.jp/articles/duckdb-s3-authentication-methods/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://dev.classmethod.jp/articles/duckdb-s3-authentication-methods/</a><a href="https://rss-mstdn.studiofreesia.com/tags/dev_classmethod" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dev_classmethod</a> <a href="https://rss-mstdn.studiofreesia.com/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a> <a href="https://rss-mstdn.studiofreesia.com/tags/Amazon_S3" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Amazon_S3</a> <a href="https://rss-mstdn.studiofreesia.com/tags/AWS_IAM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AWS_IAM</a> <a href="https://rss-mstdn.studiofreesia.com/tags/AWS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#AWS</a>

Mohit Sindhwani$ duckdb -version v1.2.1 8e52ec4395Ok, <a href="https://ruby.social/tags/DuckDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DuckDB</a> updated - it's time to try the UI! <a href="https://duckdb.org/2025/03/12/duckdb-ui" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://duckdb.org/2025/03/12/duckdb-ui</a><a href="https://ruby.social/tags/programming" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#programming</a>

Recent searches

Search options

Administered by:

Server stats:

#duckdb