mstdn.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
A general-purpose Mastodon server with a 500 character limit. All languages are welcome.

Administered by:

Server stats:

13K
active users

#tokenization

4 posts4 participants1 post today
The Lebowski<p>Hey <a href="https://mastodon.world/tags/crypto" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>crypto</span></a> fam! 🚀 Robinhood stock is soaring near record highs as their tokenization strategy gains traction. Bullish on blockchain! 💰 <a href="https://mastodon.world/tags/Robinhood" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Robinhood</span></a> <a href="https://mastodon.world/tags/tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tokenization</span></a></p>
Vietnam Insider<p>We're <a href="https://mastodon.social/tags/tokenizing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tokenizing</span></a> company shares and real-world assets in <a href="https://mastodon.social/tags/EU" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EU</span></a> and Central Asia to unlock global capital and offer diversified returns. Seeking expert advisors to shape our comprehensive <a href="https://mastodon.social/tags/tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tokenization</span></a> strategy.</p><p><a href="https://vietnaminsiders.com/strategic-tokenization-initiative-unlock-new-capital-and-global-reach/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">vietnaminsiders.com/strategic-</span><span class="invisible">tokenization-initiative-unlock-new-capital-and-global-reach/</span></a></p>
The Lebowski<p>Hong Kong is solidifying its position as Asia's crypto hub with a third batch of tokenized bonds! 🇭🇰💰 More digital asset offerings are on the horizon. <a href="https://mastodon.world/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.world/tags/HongKong" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HongKong</span></a> <a href="https://mastodon.world/tags/DeFi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DeFi</span></a></p>
Walk News<p><a href="https://www.walknews.com/964668/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">walknews.com/964668/</span><span class="invisible"></span></a> ジェミナイ、EUでトークン化株式の提供開始──まずはストラテジー株から | CoinDesk JAPAN(コインデスク・ジャパン) <a href="https://jforo.com/tags/EU" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EU</span></a> <a href="https://jforo.com/tags/Europe" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Europe</span></a> <a href="https://jforo.com/tags/EuropeNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EuropeNews</span></a> <a href="https://jforo.com/tags/EuropeanUnion" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EuropeanUnion</span></a> <a href="https://jforo.com/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://jforo.com/tags/%E3%83%A8%E3%83%BC%E3%83%AD%E3%83%83%E3%83%91" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ヨーロッパ</span></a> <a href="https://jforo.com/tags/%E3%83%A8%E3%83%BC%E3%83%AD%E3%83%83%E3%83%91%E3%83%8B%E3%83%A5%E3%83%BC%E3%82%B9" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ヨーロッパニュース</span></a> <a href="https://jforo.com/tags/%E6%AC%A7%E5%B7%9E" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>欧州</span></a> <a href="https://jforo.com/tags/%E6%AC%A7%E5%B7%9E%E9%80%A3%E5%90%88" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>欧州連合</span></a></p>
Paul Houle<p>⛓️‍💥 Broken Tokens? Your Language Model can Secretly Handle Non-Canonical Tokenizations</p><p><a href="https://arxiv.org/abs/2506.19004" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">arxiv.org/abs/2506.19004</span><span class="invisible"></span></a></p><p><a href="https://mastodon.social/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://mastodon.social/tags/llm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>llm</span></a> <a href="https://mastodon.social/tags/cs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>cs</span></a> <a href="https://mastodon.social/tags/research" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>research</span></a> <a href="https://mastodon.social/tags/tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tokenization</span></a> <a href="https://mastodon.social/tags/language" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>language</span></a></p>
Hacker News<p>TokenDagger – A tokenizer 2-4x faster than OpenAI's Tiktoken</p><p><a href="https://github.com/M4THYOU/TokenDagger" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">github.com/M4THYOU/TokenDagger</span><span class="invisible"></span></a></p><p><a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HackerNews</span></a> <a href="https://mastodon.social/tags/TokenDagger" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TokenDagger</span></a> <a href="https://mastodon.social/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.social/tags/OpenAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenAI</span></a> <a href="https://mastodon.social/tags/Tiktoken" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tiktoken</span></a> <a href="https://mastodon.social/tags/FastTech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>FastTech</span></a> <a href="https://mastodon.social/tags/GitHub" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GitHub</span></a></p>
Hacker News<p>The Bitter Lesson is coming for Tokenization</p><p><a href="https://lucalp.dev/bitter-lesson-tokenization-and-blt/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">lucalp.dev/bitter-lesson-token</span><span class="invisible">ization-and-blt/</span></a></p><p><a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HackerNews</span></a> <a href="https://mastodon.social/tags/BitterLesson" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BitterLesson</span></a> <a href="https://mastodon.social/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.social/tags/Blockchain" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Blockchain</span></a> <a href="https://mastodon.social/tags/Crypto" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Crypto</span></a> <a href="https://mastodon.social/tags/Finance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Finance</span></a></p>
Newsramp<p>Ferrox Holdings launches innovative Titanium Token, enabling direct investment in mining assets through blockchain technology. Transforming asset financing in resource industries. <a href="https://mastodon.social/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.social/tags/Investing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Investing</span></a></p>
chribonn<p>🔍 Ever wondered why GPT splits "SuperCaliFragilisticExpialiDociouc" into 11 tokens? Tokenization quirks impact AI performance—especially in text analysis. See how code-based prompting can help bypass limitations. </p><p><a href="https://medium.com/@chribonn/ai-prompt-engineering-use-code-not-words-d523c1d51e8a" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">medium.com/@chribonn/ai-prompt</span><span class="invisible">-engineering-use-code-not-words-d523c1d51e8a</span></a></p><p><a href="https://twit.social/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NLP</span></a> <a href="https://twit.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://twit.social/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://twit.social/tags/GPT4" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>GPT4</span></a> <a href="https://twit.social/tags/TechTalk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechTalk</span></a> <a href="https://twit.social/tags/TTMO" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TTMO</span></a> <a href="https://twit.social/tags/AICode" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AICode</span></a> <a href="https://twit.social/tags/AIEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIEngineering</span></a> <a href="https://twit.social/tags/PromptHacking" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>PromptHacking</span></a></p>
The Lebowski<p>Hey Crypto Fam! 🚀 $13B fund APS just bought $3.4M in tokenized real estate via MetaWealth. 🤯 Institutional adoption of tokenized assets is here! <a href="https://mastodon.world/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.world/tags/RealEstate" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RealEstate</span></a> <a href="https://mastodon.world/tags/Crypto" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Crypto</span></a></p>
The Lebowski<p>Big news for <a href="https://mastodon.world/tags/RWA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RWA</span></a>! 🚀 Market's predicted to surge 260% in 2025 fueled by crypto regulatory clarity, pushing tokenization past $23B. <a href="https://mastodon.world/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.world/tags/DeFi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DeFi</span></a></p>
Hacker News<p>Tokenization for language modeling: BPE vs. Unigram Language Modeling (2020)</p><p><a href="https://ndingwall.github.io/blog/tokenization" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">ndingwall.github.io/blog/token</span><span class="invisible">ization</span></a></p><p><a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HackerNews</span></a> <a href="https://mastodon.social/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.social/tags/LanguageModeling" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LanguageModeling</span></a> <a href="https://mastodon.social/tags/BPE" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BPE</span></a> <a href="https://mastodon.social/tags/Unigram" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Unigram</span></a> <a href="https://mastodon.social/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NLP</span></a></p>
chribonn<p>🤖 You are aware that LLMs don’t "think" like humans? Their responses are generated probabilistically—one token at a time. Understanding tokenization is key to understanding the limitations of AIs. </p><p>www.alanbonnici.com/2025/05/ai-prompt-engineering-use-code-not-words.html</p><p><a href="https://twit.social/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://twit.social/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>MachineLearning</span></a> <a href="https://twit.social/tags/LLMs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLMs</span></a> <a href="https://twit.social/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://twit.social/tags/TechExplained" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechExplained</span></a> <a href="https://twit.social/tags/TTMO" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TTMO</span></a> <a href="https://twit.social/tags/PromptEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>PromptEngineering</span></a></p>
The Lebowski<p>Hey folks! 👋 Tokenization is democratizing finance, making traditionally exclusive assets like real estate accessible to everyone. Robinhood exec highlights its importance for financial inclusion. <a href="https://mastodon.world/tags/RWA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RWA</span></a> <a href="https://mastodon.world/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://mastodon.world/tags/DeFi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DeFi</span></a></p>
Nebraska.Code<p>Adam Barney is 'Demystifying LLMs: How They Work and Why It Matters' July 24th at Nebraska.Code().</p><p><a href="https://nebraskacode.amegala.com/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">nebraskacode.amegala.com/</span><span class="invisible"></span></a></p><p><a href="https://mastodon.social/tags/Travefy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Travefy</span></a> <a href="https://mastodon.social/tags/LargeLanguageModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LargeLanguageModels</span></a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.social/tags/languagemodels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>languagemodels</span></a> <a href="https://mastodon.social/tags/TechTalk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechTalk</span></a> <a href="https://mastodon.social/tags/tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tokenization</span></a> <a href="https://mastodon.social/tags/embeddings" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>embeddings</span></a> <a href="https://mastodon.social/tags/attentionmechanisms" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>attentionmechanisms</span></a> <a href="https://mastodon.social/tags/finetuning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>finetuning</span></a> <a href="https://mastodon.social/tags/engineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>engineering</span></a> <a href="https://mastodon.social/tags/softwareengineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>softwareengineering</span></a> <a href="https://mastodon.social/tags/softwareengineer" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>softwareengineer</span></a> <a href="https://mastodon.social/tags/Nebraska" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Nebraska</span></a> <a href="https://mastodon.social/tags/TechnologyConference" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechnologyConference</span></a> <a href="https://mastodon.social/tags/lincolnnebraska" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>lincolnnebraska</span></a> <a href="https://mastodon.social/tags/devconference" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>devconference</span></a></p>
Walk News<p><a href="https://www.walknews.com/892362/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">walknews.com/892362/</span><span class="invisible"></span></a> ロビンフッド、欧州でトークン化米証券の取引を可能にするプラットフォームを開発:ブルームバーグ | CoinDesk JAPAN(コインデスク・ジャパン) <a href="https://jforo.com/tags/Europe" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Europe</span></a> <a href="https://jforo.com/tags/EuropeNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EuropeNews</span></a> <a href="https://jforo.com/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://jforo.com/tags/%E3%83%A8%E3%83%BC%E3%83%AD%E3%83%83%E3%83%91" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ヨーロッパ</span></a> <a href="https://jforo.com/tags/%E3%83%A8%E3%83%BC%E3%83%AD%E3%83%83%E3%83%91%E3%83%8B%E3%83%A5%E3%83%BC%E3%82%B9" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ヨーロッパニュース</span></a> <a href="https://jforo.com/tags/%E6%AC%A7%E5%B7%9E" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>欧州</span></a></p>
Cryptos Newss<p>Pump.fun will not launch a token, confirms Alon Cohen. Transparency, ethics, and user trust take priority amid rising meme coin speculation.</p><p><a href="https://mastodon.social/tags/PumpFun" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>PumpFun</span></a> <a href="https://mastodon.social/tags/aloncohen" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>aloncohen</span></a> <a href="https://mastodon.social/tags/MemeCoins" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>MemeCoins</span></a> <a href="https://mastodon.social/tags/Web3Ethics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Web3Ethics</span></a> <a href="https://mastodon.social/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a></p><p><a href="https://cryptosnewss.com/pump-fun-co-founder-alon-cohen-confirms-no-token-issuance-amid-rising-market-speculation/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">cryptosnewss.com/pump-fun-co-f</span><span class="invisible">ounder-alon-cohen-confirms-no-token-issuance-amid-rising-market-speculation/</span></a></p>
Habr<p>Токенизация активов реального мира (RWA). Будущее уже наступило?</p><p>Финансовые рынки за свою многолетнюю историю претерпели множество изменений - от обмена куска пергамента на медную монету тысячи лет назад до сегодняшних фондовых бирж и деривативов на финансовые инструменты. Но прогресс не стоит на месте. И на смену текущей парадигме приходит новая - глобальные инвестиции в любой актив от любой суммы, круглосуточная торговля этими активами без посредников и лишней бюрократии. Все эти и многие другие современные механизмы торговли и инвестиций может предоставить токенизация активов реального мира . Поэтому предпринимателям, инвесторам, разработчикам и фаундерам блокчейн проектов уже сейчас стоит понимать, что стоит за нарративом RWA. Так как первопроходцы и пионеры в новых отраслях экономики всегда забирают самый жирный кусок. Содержание: 1. Интро. 2. Что такое токенизация реальных активов (RWA, Real World Assets)? Как происходит токенизация актива? 3. Перспективы развития рынка RWA. В ближайшие десять лет все будет токенизировано? 4. Какие отрасли экономики будут токенизированы быстрей, чем другие? Диджитализация - первый этап токенизации? 5. Зачем токенизация реальных активов нужна бизнесу? Зачем она нужна государству и обычным людям? 6. Какие существуют схемы токенизации активов в РФ и других юрисдикциях? 7. Реальные примеры токенизации активов в РФ и за рубежом. 8. Выводы. Токенизация реальных активов - это будущее?</p><p><a href="https://habr.com/ru/articles/900408/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">habr.com/ru/articles/900408/</span><span class="invisible"></span></a></p><p><a href="https://zhub.link/tags/RWA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>RWA</span></a> <a href="https://zhub.link/tags/%D0%A2%D0%BE%D0%BA%D0%B5%D0%BD%D0%B8%D0%B7%D0%B0%D1%86%D0%B8%D1%8F_%D1%80%D0%B5%D0%B0%D0%BB%D1%8C%D0%BD%D1%8B%D1%85_%D0%B0%D0%BA%D1%82%D0%B8%D0%B2%D0%BE%D0%B2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Токенизация_реальных_активов</span></a> <a href="https://zhub.link/tags/%D1%82%D0%BE%D0%BA%D0%B5%D0%BD%D0%B8%D0%B7%D0%B0%D1%86%D0%B8%D1%8F" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>токенизация</span></a> <a href="https://zhub.link/tags/%D0%A7%D1%82%D0%BE_%D1%82%D0%B0%D0%BA%D0%BE%D0%B5_%D1%82%D0%BE%D0%BA%D0%B5%D0%BD%D0%B8%D0%B7%D0%B0%D1%86%D0%B8%D1%8F" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Что_такое_токенизация</span></a> <a href="https://zhub.link/tags/%D0%A7%D1%82%D0%BE_%D1%82%D0%B0%D0%BA%D0%BE%D0%B5_RWA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Что_такое_RWA</span></a> <a href="https://zhub.link/tags/Real_World_Assets" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Real_World_Assets</span></a> <a href="https://zhub.link/tags/tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tokenization</span></a> <a href="https://zhub.link/tags/Tokenization_RWA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization_RWA</span></a> <a href="https://zhub.link/tags/%D0%97%D0%B0%D1%87%D0%B5%D0%BC_%D0%BD%D1%83%D0%B6%D0%BD%D0%B0_%D1%82%D0%BE%D0%BA%D0%B5%D0%BD%D0%B8%D0%B7%D0%B0%D1%86%D0%B8%D1%8F_%D0%B1%D0%B8%D0%B7%D0%BD%D0%B5%D1%81%D1%83" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Зачем_нужна_токенизация_бизнесу</span></a> <a href="https://zhub.link/tags/%D0%A2%D0%BE%D0%BA%D0%B5%D0%BD%D0%B8%D0%B7%D0%B0%D1%86%D0%B8%D1%8F_%D1%8D%D1%82%D0%BE" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Токенизация_это</span></a></p>
AxelPolleres (Q54860587)<p>We're <a href="https://wien.rocks/tags/hiring" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>hiring</span></a>! </p><p>Two(!) full <a href="https://wien.rocks/tags/professorships" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>professorships</span></a> open in our department at WU Vienna (Vienna University of Economics and Business) under two complementary focus topics:</p><p>1) <a href="https://wien.rocks/tags/Foundations" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Foundations</span></a> of contemporary <a href="https://wien.rocks/tags/InformationSystems" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>InformationSystems</span></a>, where we look for candidates who complement and strengthen the existing research at our department in areas such as:</p><p>· <a href="https://wien.rocks/tags/ArtificialIntelligence" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ArtificialIntelligence</span></a>: <a href="https://wien.rocks/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> Systems and Architectures<br>· <a href="https://wien.rocks/tags/DataMining" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataMining</span></a> and <a href="https://wien.rocks/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>MachineLearning</span></a><br>· <a href="https://wien.rocks/tags/DistributedSystems" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DistributedSystems</span></a> and <a href="https://wien.rocks/tags/Decentralization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Decentralization</span></a><br>· <a href="https://wien.rocks/tags/DistributedLedgers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DistributedLedgers</span></a><br>· <a href="https://wien.rocks/tags/Cloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Cloud</span></a> and <a href="https://wien.rocks/tags/Virtualisation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Virtualisation</span></a><br>· <a href="https://wien.rocks/tags/IoT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>IoT</span></a> and <a href="https://wien.rocks/tags/EdgeComputing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>EdgeComputing</span></a><br>· <a href="https://wien.rocks/tags/DataGovernance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataGovernance</span></a> for AI</p><p>2) <a href="https://wien.rocks/tags/OperationsManagement" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OperationsManagement</span></a> with a focus on <a href="https://wien.rocks/tags/DigitalTransformation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DigitalTransformation</span></a>, where the candidate’s expertise falls within one of the following research areas:</p><p>· <a href="https://wien.rocks/tags/behavioural" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>behavioural</span></a> <a href="https://wien.rocks/tags/operations" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>operations</span></a><br>· AI application to <a href="https://wien.rocks/tags/process" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>process</span></a> improvements<br>· integrated <a href="https://wien.rocks/tags/supplymanagement" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>supplymanagement</span></a> and <a href="https://wien.rocks/tags/demandmanagement" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>demandmanagement</span></a><br>· <a href="https://wien.rocks/tags/ProductionPlanning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ProductionPlanning</span></a> and control<br>· <a href="https://wien.rocks/tags/SupplyChain" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SupplyChain</span></a> planning and control<br>· circular supply chains and sustainable supply chain management<br>· <a href="https://wien.rocks/tags/tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tokenization</span></a> in supply chains and new product development</p><p>Details at the link below... Please get in touch, if you want to know more!</p><p><a href="https://www.wu.ac.at/en/isom/events/isom-news/detail/open-positions-2-full-professorships-of-business-administration-and-informaton-systems" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">wu.ac.at/en/isom/events/isom-n</span><span class="invisible">ews/detail/open-positions-2-full-professorships-of-business-administration-and-informaton-systems</span></a></p>
InterNews112<p>### Современные текстовые нейросети: от теории к практике<br>Начало 2025 года ознаменовалось динамичным развитием технологий искусственного интеллекта, где ключевую роль играют крупные языковые модели. Китайская компания DeepSeek бросила вызов лидерам рынка, представив бесплатный чат-бот с открытым исходным кодом, что спровоцировало снижение акций NVIDIA на 10% и заставило Кремниевую долину пересмотреть свои стратегии[1]. Этот прорыв демонстрирует, как новые подходы к обучению моделей и оптимизации вычислительных ресурсов трансформируют индустрию ИИ.<br>## Основные понятия: нейросети и токенизация<br>Искусственные нейронные сети имитируют работу человеческого мозга, используя многослойные структуры взаимосвязанных "нейронов" для обработки информации. В контексте языковых моделей это проявляется в способности анализировать и генерировать текст, выявляя сложные закономерности в данных[1].<br>**Токенизация** представляет собой процесс разбиения текста на смысловые единицы. Например, предложение "ИИ меняет мир" распадается на три токена: ["ИИ", "меняет", "мир"]. Современные языковые модели оперируют контекстными окнами от 4 тыс. до 1 млн токенов, что определяет их способность "запоминать" предыдущие взаимодействия[1].<br>## Ведущие языковые модели<br>### OpenAI ChatGPT<br>Пионер в области языковых моделей, представивший GPT-4 и ChatGPT-5, поддерживающие до 128 тыс. токенов контекста. Универсальность позволяет использовать их как для создания художественных текстов, так и для анализа юридических документов[1]. Коммерческое API стоит $0.03 за 1 тыс. токенов ввода и требует строгой модерации контента.<br>**Автомобильный аналог**: Mercedes-Benz. **Слоган**: "Лучшее или ничего".<br>**Ссылка**: <a href="https://chat.openai.com/" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">chat.openai.com/</span><span class="invisible"></span></a><br>### DeepSeek-V3<br>Китайская разработка с открытым исходным кодом, потрясшая рынок технологических компаний. Использует инновационные методы обучения, сокращая бюджет разработки до $6 млн по сравнению с многомиллиардными затратами конкурентов[1]. Бесплатный доступ через приложение R1 с контекстным окном 32 тыс. токенов делает её популярной среди исследователей.<br>**Автомобильный аналог**: Tesla. **Слоган**: "Ускоряя переход к устойчивой энергетике".<br>**Ссылка**: <a href="https://chat.deepseek.com/" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">chat.deepseek.com/</span><span class="invisible"></span></a><br>### Anthropic Claude 3<br>Разработка, ориентированная на анализ длинных текстов с рекордным контекстом в 1 млн токенов. Оптимальна для работы с технической документацией, однако стоимость API достигает $0.25 за 1 тыс. выходных токенов. Отличается строгими этическими фильтрами контента[2].<br>**Автомобильный аналог**: Volvo. **Слоган**: "For life".<br>**Ссылка**: <a href="https://www.anthropic.com/claude" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://www.</span><span class="">anthropic.com/claude</span><span class="invisible"></span></a><br>### Qwen2.5<br>Совместный проект Alibaba и китайских исследовательских институтов. Поддерживает 64 тыс. токенов и ориентирован на мультиязычность, демонстрируя лучшие результаты для азиатских языков[3]. Бесплатная версия доступна через облачный сервис Aliyun.<br>**Автомобильный аналог**: Toyota. **Слоган**: "Let's Go Places".<br>**Ссылка**: <a href="https://qianwen.aliyun.com/" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">qianwen.aliyun.com/</span><span class="invisible"></span></a><br>## Сравнительный анализ моделей<br>**Глубина анализа**:<br>- ChatGPT: 9/10 (универсальность)<br>- DeepSeek: 8.5/10 (исследовательская направленность)<br>- Claude 3: 9.5/10 (работа с длинными текстами)<br>- Qwen2.5: 8/10 (мультиязычность)<br>**Экономическая эффективность**:<br>- DeepSeek R1: бесплатно (32k токенов)<br>- ChatGPT Plus: $20/мес (128k токенов)<br>- Claude Team: $30/мес (1M токенов)<br>- Qwen2.5: бесплатно через Aliyun (64k токенов)<br>**Ограничения**:<br>- Политическая цензура у китайских моделей<br>- Высокие требования к оборудованию для локального запуска<br>- Возможные задержки ответа в облачных решениях при высокой нагрузке<br>## Будущее индустрии<br>Падение акций NVIDIA на 10% после выхода DeepSeek свидетельствует о переходе фокуса с аппаратных мощностей на алгоритмическую эффективность. По прогнозам Citi, к 2026 году 70% задач обработки естественного языка будут выполняться моделями с открытым исходным кодом[3].<br>Развитие локальных решений создаёт новый рынок "персонализированных ИИ", где пользователи смогут обучать модели под свои нужды без зависимости от облачных платформ. Это особенно важно для малого бизнеса и независимых исследователей[4].<br>## Локальные нейросети: установка и настройка<br>Платформа **Ollama** делает запуск ИИ-моделей доступным для персональных компьютеров. Требования:<br>- Видеокарта с 8+ ГБ памяти (RTX 2070/4060)<br>- 16 ГБ оперативной памяти<br>- Поддержка CUDA (NVIDIA) или ROCm (AMD)<br>Установка через терминал:<br>```bash<br>curl -fsSL <a href="https://ollama.ai/install.sh" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">ollama.ai/install.sh</span><span class="invisible"></span></a> | sh<br>ollama run llama3<br>```<br>Этот код запускает модель LLaMA 3 с контекстом 8 тыс. токенов. Пользователи отмечают удобную интеграцию с Python-библиотеками для создания кастомных решений, хотя возможны трудности с мультиязычными ответами[6].<br>**Автомобильный аналог**: Jeep. **Слоган**: "Go Anywhere, Do Anything".<br>**Ссылка**: <a href="https://ollama.ai/" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="">ollama.ai/</span><span class="invisible"></span></a><br>## Заключение<br>Выбор языковой модели зависит от конкретных задач: DeepSeek предлагает лучшую стоимость для академических исследований, ChatGPT остаётся лидером в универсальности, Claude 3 выделяется обработкой длинных текстов, а Qwen2.5 выигрывает в мультиязычности[5]. С развитием технологий токенизация и оптимизация вычислений продолжат играть ключевую роль в удешевлении и ускорении обработки данных.<br>### Хэштеги:<br><a href="https://qoto.org/tags/AI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AI</span></a> <a href="https://qoto.org/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>MachineLearning</span></a> <a href="https://qoto.org/tags/NeuralNetworks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NeuralNetworks</span></a> <a href="https://qoto.org/tags/DeepLearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DeepLearning</span></a> <a href="https://qoto.org/tags/NLP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>NLP</span></a> <a href="https://qoto.org/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> <a href="https://qoto.org/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ChatGPT</span></a> <a href="https://qoto.org/tags/ClaudeAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ClaudeAI</span></a> <a href="https://qoto.org/tags/DeepSeek" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DeepSeek</span></a> <a href="https://qoto.org/tags/Qwen" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Qwen</span></a> <a href="https://qoto.org/tags/Ollama" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Ollama</span></a> <a href="https://qoto.org/tags/Tokenization" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Tokenization</span></a> <a href="https://qoto.org/tags/OpenSourceAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>OpenSourceAI</span></a> <a href="https://qoto.org/tags/TechTrends" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechTrends</span></a> <a href="https://qoto.org/tags/AIResearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIResearch</span></a> <a href="https://qoto.org/tags/AIModels" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIModels</span></a> <a href="https://qoto.org/tags/AIInnovation" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AIInnovation</span></a><br>### Литература:<br>1. Bengio Y., Goodfellow I., Courville A. *Deep Learning*. MIT Press, 2016.<br>2. Vaswani A. et al. *Attention is All You Need*. NeurIPS, 2017.<br>3. Brown T. et al. *Language Models are Few-Shot Learners*. NeurIPS, 2020.<br>4. OpenAI Research. *Scaling Laws for Neural Language Models*, 2020.<br>5. Hestness J. et al. *Deep Learning Scaling is Predictable, Empirically*. arXiv:1712.00409, 2017.<br>6. Radford A. et al. *Improving Language Understanding by Generative Pre-Training*. OpenAI, 2018.<br>7. DeepSeek AI. *Technical Report on DeepSeek-V3*, 2025.<br>8. Anthropic AI. *Claude Model Architecture and Capabilities*, 2024.<br>9. Alibaba Cloud Research. *Qwen Model Overview*, 2024.<br>10. NVIDIA AI Labs. *Future of AI Hardware and Optimization*, 2024.<br>11. Citigroup AI Analysis. *Market Trends in LLM Development*, 2025.<br>12. Stanford NLP Group. *Comprehensive Guide to Tokenization*, 2023.</p><p><a href="https://bastyon.com/post?s=47273c436dce8b15495f4d1464b26e787967cdf03ace2adf285c579f24f09cf3&amp;ref=PMC55eKCrsxoJNkiB3f71AgFLQC3T9HkWV" rel="nofollow noopener noreferrer" target="_blank"><span class="invisible">https://</span><span class="ellipsis">bastyon.com/post?s=47273c436dc</span><span class="invisible">e8b15495f4d1464b26e787967cdf03ace2adf285c579f24f09cf3&amp;ref=PMC55eKCrsxoJNkiB3f71AgFLQC3T9HkWV</span></a></p>