mstdn.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A general-purpose Mastodon server with a 500 character limit. All languages are welcome.

Administered by:

Server stats:

10K
active users

#deduplication

1 post1 participant0 posts today
Hacker News<p>Borg - Deduplicating Archiver with Compression and Encryption</p><p><a href="https://www.borgbackup.org/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">borgbackup.org/</span><span class="invisible"></span></a></p><p><a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>HackerNews</span></a> <a href="https://mastodon.social/tags/Borg" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Borg</span></a> <a href="https://mastodon.social/tags/Deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Deduplication</span></a> <a href="https://mastodon.social/tags/Compression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Compression</span></a> <a href="https://mastodon.social/tags/Encryption" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Encryption</span></a> <a href="https://mastodon.social/tags/Backup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Backup</span></a></p>
Stéphane Klein<p>J'ai lu le très bon billet d' <span class="h-card" translate="no"><a href="https://mastodon.xyz/@athoune" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>athoune</span></a></span> sur <a href="https://social.coop/tags/Kloset" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Kloset</span></a>, moteur de stockage de backup de <a href="https://social.coop/tags/Plakar" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Plakar</span></a></p><p><a href="https://notes.sklein.xyz/2025-06-16_1639/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">notes.sklein.xyz/2025-06-16_16</span><span class="invisible">39/</span></a></p><p><a href="https://social.coop/tags/TIL" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>TIL</span></a> <a href="https://social.coop/tags/Backup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Backup</span></a> <a href="https://social.coop/tags/Restic" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Restic</span></a> <a href="https://social.coop/tags/Deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Deduplication</span></a></p>
BLACKVOID ⚫️<p>Testing some more concurrent operations on the new <a href="https://mastodon.social/tags/Synology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Synology</span></a> <a href="https://mastodon.social/tags/DS925" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DS925</span></a>+ as part of the upcoming <a href="https://mastodon.social/tags/review" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>review</span></a></p><p>Dual <a href="https://mastodon.social/tags/ActiveBackupForBusiness" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ActiveBackupForBusiness</span></a> remote <a href="https://mastodon.social/tags/windows11" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>windows11</span></a> machines (testing the <a href="https://mastodon.social/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> in the process), along a simple file copy onto an external <a href="https://mastodon.social/tags/USB" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>USB</span></a> <a href="https://mastodon.social/tags/SSD" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SSD</span></a> <a href="https://mastodon.social/tags/OWC" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OWC</span></a> enclosure.</p><p>(yes 3rd party external drives work just fine!)</p><p>The NAS is nice and calm with no performance issues at all.</p>
The OpenAIRE Graph<p>Happening now! In this month's <a href="https://mastodon.social/tags/CommunityCall" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CommunityCall</span></a>, <a href="https://mastodon.social/tags/OpenAIREGraph" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenAIREGraph</span></a> Training &amp; Engagement Officer Stefania Amodeo takes us on a journey through the Graph <a href="https://mastodon.social/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> process that uses a combination of advanced algorithms &amp; human expertise. Missed out? All past <a href="https://mastodon.social/tags/CommunityCall" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CommunityCall</span></a> materials can be found on the Graph portal, today's to be uploaded in the coming days. </p><p>Past Calls <a href="https://graph.openaire.eu/community-calls" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">graph.openaire.eu/community-ca</span><span class="invisible">lls</span></a></p>
chuckwalla, esq<p>anyone know of an implementation of the CPM-SW deduplication algorithm of <a href="https://hal.science/hal-03976889/" rel="nofollow noopener" target="_blank">this paper</a>?</p><p>[edited to change the url to the abstract page rather than direct to the pdf]</p><p><a href="https://why.omigad.wtf/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> <a href="https://why.omigad.wtf/tags/algorithm" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>algorithm</span></a></p>
Peter N. M. Hansteen<p>The Problem Isn't Email, It's Microsoft Exchange -- it turns out my 2011-vintage rant still rings true, now also available trackerless: <a href="https://nxdomain.no/~peter/the_problem_isnt_email_its_microsoft_exchange.html" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">nxdomain.no/~peter/the_problem</span><span class="invisible">_isnt_email_its_microsoft_exchange.html</span></a> <a href="https://mastodon.social/tags/inefficiency" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>inefficiency</span></a> <a href="https://mastodon.social/tags/timewasted" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>timewasted</span></a> <a href="https://mastodon.social/tags/email" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>email</span></a> <a href="https://mastodon.social/tags/archiving" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>archiving</span></a> <a href="https://mastodon.social/tags/microsoft" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>microsoft</span></a> <a href="https://mastodon.social/tags/exchange" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>exchange</span></a> <a href="https://mastodon.social/tags/compliance" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>compliance</span></a> <a href="https://mastodon.social/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> <a href="https://mastodon.social/tags/unsolvedproblems" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>unsolvedproblems</span></a> <a href="https://mastodon.social/tags/smtp" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>smtp</span></a> <a href="https://mastodon.social/tags/mail" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>mail</span></a> <a href="https://mastodon.social/tags/annoyances" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>annoyances</span></a></p>
BLACKVOID ⚫️<p>Testing <a href="https://mastodon.social/tags/Synology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Synology</span></a> <a href="https://mastodon.social/tags/ActiveProtectManager" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ActiveProtectManager</span></a> and <a href="https://mastodon.social/tags/DP320" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DP320</span></a> appliance by making the ISO bare metal recovery media.</p><p>Let's see how fast this little machine can recover a 50GB setup.</p><p>The actual <a href="https://mastodon.social/tags/backup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>backup</span></a> and <a href="https://mastodon.social/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> are working really well.</p>
Matt Knight<p>Would I be crazy to enable deduplication on the ZFS dataset for a Postgres database? It seems like it would massively reduce the size of snapshots, which I replicate remotely using send / receive (they’re encrypted too).</p><p>The database in question is &lt;20GB, and the server has 128GB RAM (plenty free). ZFS is on the (Proxmox) host, Postgres is in an LXC. Snapshots with Sanoid.</p><p><a href="https://mastodon.knight.fyi/tags/zfs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zfs</span></a> <a href="https://mastodon.knight.fyi/tags/postgres" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>postgres</span></a> <a href="https://mastodon.knight.fyi/tags/postgresql" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>postgresql</span></a> <a href="https://mastodon.knight.fyi/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> <a href="https://mastodon.knight.fyi/tags/homelab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>homelab</span></a> <a href="https://mastodon.knight.fyi/tags/selfhosted" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>selfhosted</span></a> <a href="https://mastodon.knight.fyi/tags/database" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>database</span></a> <a href="https://mastodon.knight.fyi/tags/proxmox" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>proxmox</span></a> <a href="https://mastodon.knight.fyi/tags/lxc" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>lxc</span></a> <a href="https://mastodon.knight.fyi/tags/sanoid" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>sanoid</span></a></p>
Habr<p>[Перевод] Дедупликация в OpenZFS теперь хороша, но использовать её не стоит</p><p>Вот-вот выйдет релиз OpenZFS 2.3.0 с новой функцией Fast Dedup . Это огромный шаг вперёд по сравнению со старой дедупликацией и отличный фундамент для будущих доработок. Контрибьютор OpenZFS @gmelikov и команда VK Cloud совместно перевели статью об этом релизе, в которой новая функция сравнивается со старой дедупликацией и описывается максимально подробно с практическими примерами. В 2023–2024 коллеги из Klara много работали над этой функцией, и мы согласны с ними, что она весьма хороша! После релиза Fast dedup на многих ресурсах в обсуждениях продолжили писать, что «новый дедуп всё так же плох, он требует столько же ОЗУ и также убивает производительность». Но эта информация лишь отчасти близка к правде и повторяет всё тот же мотив, который когда-то кто-то озвучивал на форумах. Винить в этом никого не хочется. И не стоит, так как дедупликация в OpenZFS и правда была очень требовательной к правильному применению. Найти качественные гайды тоже не просто, ответ по умолчанию — «не используйте её» — был и (в целом) остаётся правильным. Но, по прошествии почти 20 лет жизни дедупа в OpenZFS, настало время вернуться к этому вопросу. Посмотрим на свежую информацию об имплементации дедупа в OpenZFS, как он работал до улучшений, в чём была его проблема, что поменяли в fast dedup, и почему же это всё ещё не дефолт.</p><p><a href="https://habr.com/ru/companies/vk/articles/863904/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">habr.com/ru/companies/vk/artic</span><span class="invisible">les/863904/</span></a></p><p><a href="https://zhub.link/tags/zfs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zfs</span></a> <a href="https://zhub.link/tags/openzfs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>openzfs</span></a> <a href="https://zhub.link/tags/reflink" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reflink</span></a> <a href="https://zhub.link/tags/dedup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dedup</span></a> <a href="https://zhub.link/tags/storage" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>storage</span></a> <a href="https://zhub.link/tags/filesystem" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>filesystem</span></a> <a href="https://zhub.link/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a></p>
Cyclone<p><a href="https://infosec.exchange/tags/CynosurePrime" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CynosurePrime</span></a> has released <a href="https://infosec.exchange/tags/rlite" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>rlite</span></a>, a lightweight alternative to <a href="https://infosec.exchange/tags/rling" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>rling</span></a>. Designed for fast <a href="https://infosec.exchange/tags/wordlist" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>wordlist</span></a> <a href="https://infosec.exchange/tags/sorting" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>sorting</span></a>, <a href="https://infosec.exchange/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a>, and simple analytics.<br><a href="https://forum.hashpwn.net/post/204" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">forum.hashpwn.net/post/204</span><span class="invisible"></span></a></p><p><a href="https://infosec.exchange/tags/hashpwn" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>hashpwn</span></a> <a href="https://infosec.exchange/tags/rling" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>rling</span></a> <a href="https://infosec.exchange/tags/CsP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>CsP</span></a> <a href="https://infosec.exchange/tags/hashcracking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>hashcracking</span></a></p>
Kevin Karhan :verified:<p><span class="h-card" translate="no"><a href="https://mastodon.bsd.cafe/@poes" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>poes</span></a></span> maybe they use RAM <a href="https://infosec.space/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> host-side to cram more <a href="https://infosec.space/tags/VMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>VMs</span></a> on the same machine?</p><ul><li>Or the VM needs <a href="https://infosec.space/tags/GuestAdditions" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GuestAdditions</span></a> to request the full amount as per preconfig??</li></ul><p>Some Hypervisors like <a href="https://infosec.space/tags/vmware" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>vmware</span></a> tend to dynamically scale <a href="https://infosec.space/tags/RAM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RAM</span></a>...</p>
BackUpScale<p>Introducing Unlimited Backup Repositories: <a href="https://backupscale.com/posts/introducing-unlimited-backup-repositories/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">backupscale.com/posts/introduc</span><span class="invisible">ing-unlimited-backup-repositories/</span></a> <a href="https://mastodon.social/tags/restic" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>restic</span></a> <a href="https://mastodon.social/tags/unlimited" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>unlimited</span></a> <a href="https://mastodon.social/tags/backup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>backup</span></a> <a href="https://mastodon.social/tags/repository" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>repository</span></a> <a href="https://mastodon.social/tags/backups" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>backups</span></a> <a href="https://mastodon.social/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> <a href="https://mastodon.social/tags/flexibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>flexibility</span></a> <a href="https://mastodon.social/tags/ransomware" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ransomware</span></a> <a href="https://mastodon.social/tags/protection" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>protection</span></a> <a href="https://mastodon.social/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>opensource</span></a> <a href="https://mastodon.social/tags/opensaas" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>opensaas</span></a> <a href="https://mastodon.social/tags/cybersecurity" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>cybersecurity</span></a> <a href="https://mastodon.social/tags/infosec" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>infosec</span></a></p>
sebsauvage<p>🐧 <a href="https://framapiaf.org/tags/btrfs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>btrfs</span></a> <a href="https://framapiaf.org/tags/d%C3%A9duplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>déduplication</span></a> <br>Mmm... je suis dubitatif.<br>duperemove déduplique au niveau blocs. jdupes seulement au niveau fichiers.<br>Donc en théorie dupreremove est plus efficace.</p><p>J'ai donc récupéré la dernière version de duperemove et j'ai refait un test.</p><p>Place libre sur mon disque : 221,9 Go avant dédupe.<br>Je passe duperemove sur mon /home : 222,4 Go libres.<br>En théorie jdupes ne devrait rien gagner. Je le passe: 223,6 Go libres après.</p><p>C'est pas logique.<br>Tant pis je continue avec jdupes, du coup.</p>
Habr<p>Есть ли жизнь до fit/predict?</p><p>Всем привет! Меня зовут Даниил Карпов, я старший NLP-разработчик в MTS AI. В эпоху LLM и огромных датасетов, вмещающих в себя весь интернет, кажется, что качество самих данных ушло немного на второй план: чем больше данных/параметров, тем лучше. Однако экстенсивный рост рано или поздно упирается в ограничения, когда становится уже слишком дорого/невозможно его продолжать. Роль хороших данных не стоит недооценивать, грамотный отбор может помочь значительно ускорить и удешевить обучение с одной стороны, тогда как отбраковка откровенно плохой разметки поможет улучшить качество с другой. Здесь я расскажу о некоторых из таких методов, которые использовались в процессе подготовки данных.</p><p><a href="https://habr.com/ru/companies/mts_ai/articles/825090/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">habr.com/ru/companies/mts_ai/a</span><span class="invisible">rticles/825090/</span></a></p><p><a href="https://zhub.link/tags/nlp" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>nlp</span></a> <a href="https://zhub.link/tags/dataset_cartography" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataset_cartography</span></a> <a href="https://zhub.link/tags/vinformation" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>vinformation</span></a> <a href="https://zhub.link/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> <a href="https://zhub.link/tags/d4" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>d4</span></a> <a href="https://zhub.link/tags/semdedup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>semdedup</span></a> <a href="https://zhub.link/tags/sslprototypes" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>sslprototypes</span></a> <a href="https://zhub.link/tags/data_quality" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>data_quality</span></a> <a href="https://zhub.link/tags/dataset_difficulty" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dataset_difficulty</span></a> <a href="https://zhub.link/tags/%D0%BF%D0%BE%D0%B4%D0%B3%D0%BE%D1%82%D0%BE%D0%B2%D0%BA%D0%B0_%D0%B4%D0%B0%D0%BD%D0%BD%D1%8B%D1%85" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>подготовка_данных</span></a></p>
R. L. Dane :Debian:<p>Never could get any of the contacts merge scripts kindly recommended to me by the <a href="https://alpha.polymaths.social/tags/askfedi" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>AskFedi</span></a> <a href="https://alpha.polymaths.social/tags/hivemind" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>HiveMind</span></a> to work, but I finally found my own solution, which should hopefully work:</p><p>@libreoffice! ;) (and of course <span class="h-card"><a href="https://mastodon.online/@thunderbird" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>thunderbird</span></a></span>)</p><ol><li>Export contacts from Thunderbird to .csv</li><li>Make a copy of Contacts.csv for safekeeping, I called mine "Contacts-before-jiggerypokery.csv" ;)</li><li>Open Contacts.csv in LO Calc</li><li>Create a key column (A), put "Join" as the label in A1</li><li>Put <code>=TEXTJOIN(" ^ ",1,C2:AM2)</code> into A2 <em>(You may have to replace AM2 with the end of your row if your CSV export has a different number of columns than mine)</em></li><li>Copy that cell and paste it down the entire column A (for every row that contains something)</li><li>Select A1 only, go to Data | More Filters | Standard Filter...</li><li>Make sure your A1 field ("Join") is selected, select "Not Empty" for the value, click "&gt; Options" and select "No duplications" on the right</li><li>Hit Ok</li><li>Copy everything (now de-duped) to a new sheet, delete the old one</li><li>Create another new column (B) just to the right of the "Join" column, call it "Repeat?"</li><li>Paste <code>=IF(TEXTJOIN("",1,C3:D3)=TEXTJOIN("",1,C2:D2),"REPEAT","")</code> into B3</li><li>Copy B3 and paste it down the entire B column (down to the end of the data)</li><li>Look where you see REPEAT, and merge the rows that need to be merged</li><li>Delete Columns A and B (which you added), and save the CSV</li><li>Delete all of your contacts in Thunderbird, and import the new Contacts.csv</li><li>Pray</li><li>Sync your contacts</li><li>Enjoy!!!</li></ol><p><strong>Disclaimer, again: I am still going through my spreadsheet, so I don't know for sure that this works!! XD</strong></p><p><a href="https://alpha.polymaths.social/tags/managecontacts" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ManageContacts</span></a> <a href="https://alpha.polymaths.social/tags/contacts" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Contacts</span></a> <a href="https://alpha.polymaths.social/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DeDuplication</span></a> <a href="https://alpha.polymaths.social/tags/degoogled" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>DeGoogled</span></a> <a href="https://alpha.polymaths.social/tags/ungoogled" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>UnGoogled</span></a> <a href="https://alpha.polymaths.social/tags/howto" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>HowTo</span></a></p>
Habr<p>Дедупликация данных в Windows 10 и Windows 11 средствами Microsoft</p><p>Сегодня я кратко расскажу вам как включить дедупликацию данных в клиентских ОС - Windows 10 и Windows 11, добавив функционал из Windows Server, причем не какие-то сторонние бинарники, а оригинальные, подписанные файлы Microsoft, которые к тому же будут обновляться через Windows Update. В этой статье не будет описания дедупликации данных, - разве что совсем кратко что это такое, и не будет сравнения решений разных вендоров. Я дам ниже ссылки на достойные, на мой взгляд, статьи других авторов и готов буду отвечать на вопросы, если их зададут ниже в виде комментария или в ПМ. Начать знакомство рекомендую с базовой теории Введение в дедупликацию данных / Хабр (habr.com) от компании Veeam, затем почитать о том, что такое дедупликация Microsoft - Обзор и настройка средств дедупликации в Windows Server 2012 / Хабр (habr.com) - статья моего бывшего коллеги по Microsoft Георгия говорит о том, как настраивается дедупликация NTFS в Windows Server 2012. В последующих изданиях Windows Server 2012R2, 2016, 2019, 2022 и 2025 функционал развивался, появилась поддержка ReFS, стало возможно (неочевидным способом) дедуплицировать системный том, расширились компоненты управления, - но для конечного пользователя все остается там же. Установили одним кликом, включили для диска, забыли. В заключение подготовительной информации - тем кого действительно интересует кроссплатформенные решения и их сравнения, предложу ознакомиться со статьей Илии Карина - Dedup Windows vs Linux, MS снова “удивит”? / Хабр (habr.com) - его не должны заподозрить в рекламе Microsoft, его сравнение подходов, и результат меня самого удивил. У меня на такую большую исследовательскую работу сил и возможностей нет, - почитайте. И имейте в виду, что если вы используете последний Windows 11, то и компоненты дедупликации в нем будут последние, от Windows Server 2025, то есть с еще более впечатляющим результатом.</p><p><a href="https://habr.com/ru/articles/822117/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">habr.com/ru/articles/822117/</span><span class="invisible"></span></a></p><p><a href="https://zhub.link/tags/%D0%B4%D0%B5%D0%B4%D1%83%D0%BF%D0%BB%D0%B8%D0%BA%D0%B0%D1%86%D0%B8%D1%8F" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>дедупликация</span></a> <a href="https://zhub.link/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> <a href="https://zhub.link/tags/dedup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dedup</span></a> <a href="https://zhub.link/tags/tweak" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>tweak</span></a></p>
Maciej Beręsewicz<p>Are you dealing with <a href="https://fosstodon.org/tags/RecordLinkage" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RecordLinkage</span></a> or <a href="https://fosstodon.org/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a> You can check out the <a href="https://fosstodon.org/tags/rstats" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>rstats</span></a> {blocking} package, which can help you significantly improve your pipeline and reduce FDR due to blocking. It uses several nice <a href="https://fosstodon.org/tags/ANN" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ANN</span></a> algorithms via excellent {rnndescent}, {RcppHNSW} and {RcppAnnoy} packages. It is nicely integrated with the {reclin2} package and works well with {fastLink}. Feel free to check it out in your applications and send us feedback! <a href="https://github.com/ncn-foreigners/blocking" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">github.com/ncn-foreigners/bloc</span><span class="invisible">king</span></a></p>
Inautilo<p><a href="https://mastodon.social/tags/Business" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Business</span></a> <a href="https://mastodon.social/tags/Explainers" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Explainers</span></a><br>Google explains how it chooses canonical webpages · Why duplicate pages can be important for SEO <a href="https://ilo.im/15yhco" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">ilo.im/15yhco</span><span class="invisible"></span></a></p><p>_____<br><a href="https://mastodon.social/tags/SEO" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SEO</span></a> <a href="https://mastodon.social/tags/Google" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Google</span></a> <a href="https://mastodon.social/tags/SearchEngine" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SearchEngine</span></a> <a href="https://mastodon.social/tags/Website" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Website</span></a> <a href="https://mastodon.social/tags/Webpage" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Webpage</span></a> <a href="https://mastodon.social/tags/Content" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Content</span></a> <a href="https://mastodon.social/tags/Deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Deduplication</span></a> <a href="https://mastodon.social/tags/Canonicalization" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Canonicalization</span></a> <a href="https://mastodon.social/tags/Design" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Design</span></a> <a href="https://mastodon.social/tags/WebDesign" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>WebDesign</span></a></p>
CipherdMini tutorial: How to incrementally backup a server (with rsync)
Alex Willmer<p>Making a magic deduplicating tar using the FICLONE ioctl <a href="https://media.ccc.de/v/all-systems-go-2023-225-making-a-magic-deduplicating-tar-using-the-ficlone-ioctl" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">media.ccc.de/v/all-systems-go-</span><span class="invisible">2023-225-making-a-magic-deduplicating-tar-using-the-ficlone-ioctl</span></a> block aligning payloads in a tar file allows filesystems (e.g. btrfs, zfs) to deduplicate that data on disk. The tool is <a href="https://git.sr.ht/~nullenenenen/deduptar" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">git.sr.ht/~nullenenenen/dedupt</span><span class="invisible">ar</span></a><br><a href="https://social.moreati.org.uk/tags/tar" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>tar</span></a> <a href="https://social.moreati.org.uk/tags/deduptar" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduptar</span></a> <a href="https://social.moreati.org.uk/tags/deduplication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>deduplication</span></a></p>