Gate News message, April 23 — DeepSeek has open-sourced TileKernels under the MIT license, a GPU kernel library written in TileLang for large language model training and inference. TileLang is a domain-specific language developed by the tile-ai team for expressing high-performance GPU kernels in Python. DeepSeek stated that most kernels in the library have approached hardware performance limits in compute density and memory bandwidth, with portions already deployed in internal training and inference operations.
The library comprises six categories of kernels: MoE (mixture of experts) gating and routing, including Top-k expert selection, token-to-expert mapping, and fused expand/shrink with weight normalization; quantization supporting FP8, FP4, and E5M6 formats with per-token, per-block, and per-channel quantization, including fused SwiGLU+quantization operations; batch transpose; Engram gating with fused RMSNorm forward/backward propagation and weight gradient reduction; Manifold HyperConnection with Sinkhorn normalization and mixed split/apply; and high-level autograd interfaces that wrap low-level kernels into trainable layers.
Engram and Manifold HyperConnection are proprietary components of DeepSeek’s model architecture, with implementation details disclosed publicly for the first time. The library requires NVIDIA SM90 or SM100 architecture GPUs (H100/H200 or Blackwell series), CUDA Toolkit 13.1 or higher, and PyTorch 2.10 or higher.
Disclaimer: The information on this page may come from third parties and does not represent the views or opinions of Gate. The content displayed on this page is for reference only and does not constitute any financial, investment, or legal advice. Gate does not guarantee the accuracy or completeness of the information and shall not be liable for any losses arising from the use of this information. Virtual asset investments carry high risks and are subject to significant price volatility. You may lose all of your invested principal. Please fully understand the relevant risks and make prudent decisions based on your own financial situation and risk tolerance. For details, please refer to
Disclaimer.
Related Articles
Samsung SDS Secures Contract to Build Tokenised Securities Platform for KSD, Completion Set for February 2027
Samsung SDS has secured a contract from Korea Securities Depository (KSD) to develop a tokenised securities platform ahead of South Korea's 2027 digital securities framework. The platform, expected to be completed by February 2027, will connect blockchain-based distributed ledger infrastructure
GateNews14m ago
Aave Liquidates Kelp DAO Attacker's Remaining rsETH Positions
According to Aave's announcement on Wednesday, the onchain lending platform has liquidated the Kelp DAO attacker's remaining rsETH positions as part of a previously announced recovery plan. The liquidated collateral has been moved to the Recovery Guardian, a multisig managed by the DeFi United
GateNews57m ago
Bullish Completes Tokenization of 151 Million Shares on Solana at Consensus 2026
According to Bullish CEO Thomas Farley at Consensus 2026, the company has completed the tokenization of its entire equity (151 million shares) on Solana. Farley demonstrated a live transfer using Phantom wallet during the
GateNews2h ago
Pi Network founder attends Consensus 2026 and delivers a speech on identity verification in the AI era
According to an announcement from Pi Network’s official X account, Pi Network co-founder Chengdiao Fan delivered a speech at Consensus 2026 in Miami, USA on May 6 on “Practical Integration of Web3, AI, and Blockchain,” while Kokalys participated on May 7 in a discussion titled “How to Prove You’re Human in an AI World.”
MarketWhisper3h ago
Aave liquidates the Kelp DAO attacker’s positions, and the Arbitrum vote approves unfreezing rsETH
According to Aave’s May 7 announcement, the Arbitrum DAO voting to unlock ETH related to the April 18 rsETH incident has reached the quorum, with over 1,600 addresses, receiving unanimous support from the community. On the same day, Aave, following its established governance procedures, completed the liquidation of the remaining rsETH positions in the Aave protocol held by the attacker of Kelp DAO.
MarketWhisper3h ago
Gnosis DAO Redemption Vote Flips as 67,000 GNO Whale Backs Proposal; 65% Support
According to ChainCatcher, Gnosis DAO is conducting a Snapshot vote allowing GNO holders to redeem DAO treasury shares proportionally. The treasury holds approximately $223 million in assets, with 1.3 million GNO eligible for redemption at roughly $170 per token versus the current trading price
GateNews3h ago
