1+ hour, 50+ min ago  (1618+ words) cuTile Python, the Python DSL expression of the CUDA Tile programming model, is releasing a number of feature enhancements. These include enhanced language support for the following: We've also provided an easy installation path. The following pip install command will…...

3+ hour, 35+ min ago  (641+ words) These contributions demonstrate how Megatron Core users can extend the framework to support their own custom model architectures and complex training features and leverage the work of others in the community. The implementation of the Falcon-H1 parallel hybrid architecture within…...

6+ hour, 5+ min ago  (1066+ words) In KV cache loading, storage is used to help with growing KV caches in multiturn and agentic AI workloads such as coding assistants and reasoning. For the case of long context KV, the previous results can be loaded from local…...

6+ hour, 51+ min ago  (602+ words) AIConfigurator, an open source collaboration that works on NVIDIA Dynamo, is making multi-framework LLM deployment faster and easier. This blog will provide a quick overview of how AIConfigurator works; how to use it with Dynamo; and how ecosystem contributors such…...

4+ day, 6+ hour ago  (268+ words) The following code shows how to specify the determinism level in CUB (find the complete example online using compiler explorer). There are three determinism levels available for reduction, which are: For applications that require the highest level of reproducibility, CUB…...

4+ day, 6+ hour ago  (1126+ words) The Strategic Technology Analysis Center (STAC) has been developing benchmarks for the workloads key to the financial industry for over 15 years. They have now developed the STAC-AI benchmark to help companies assess the end-to-end retrieval-augmented generation (RAG) and LLM inference…...

5+ day, 7+ hour ago  (1342+ words) In this post, we dive into one of the most critical workloads in modern AI: Flash Attention, where you'll learn: See the quickstart doc for more information on installing cuTile Python. The attention mechanism is the computational heart of transformer…...

6+ day, 4+ hour ago  (622+ words) NVIDIA CUDA Tile is one of the most significant additions to NVIDIA CUDA programming and unlocks automatic access to tensor cores and other specialized hardware. Earlier this year, NVIDIA released cuTile for Python, giving Python developers a natural way to…...

6+ day, 4+ hour ago  (823+ words) NVIDIA ACE is a suite of technologies for building AI agents for gaming. ACE provides ready-to-integrate cloud and on-device AI models for every part of in-game characters, from speech to intelligence to animation. To run these models alongside the game…...

1+ week, 1+ day ago  (445+ words) To make 6G a reality, the telecom industry must overcome a fundamental challenge: how to design, train, and validate AI-native networks that are too complex to be tested in the physical world. But the usability of any technology is as important…...