Near Protocol Announces Plans For World’s Largest Open-source AI Model

As a seasoned crypto investor with a keen eye for disruptive technology, I find Near Protocol’s ambitious AI project incredibly intriguing. Having witnessed the meteoric rise of AI giants like ChatGPT and Meta, this initiative by Illia Polosukhin and his team at Near Protocol promises to push the boundaries even further.


The initiative presented by NEAR Co-Founder and CEO Illia Polosukhin at the conference in Bangkok, Thailand, aspires to exceed Meta’s Llama model by a multiplier of 3.5, establishing a new standard for AI performance.

The Vision Behind the 1.4 Trillion Parameter Model

The goal of Near Protocol’s ambitious venture transcends mere size; it aims to cultivate a cooperative artificial intelligence network. By utilizing a crowdsourced development model, this project encourages countless contributors to engage through the recently established Near AI Research center. Initially starting with a 500 million parameter model, the project will gradually expand in scale. Contributors will be evaluated and promoted based on their performance and input, creating a merit-based development ecosystem that fosters progress and complexity within the models, ultimately promoting a more democratic and effective development environment.

Funding and Monetization Strategies

Investing in training such a large-scale model is a pricey undertaking, with projected costs reaching approximately $160 million. The Near Protocol team intends to cover these expenses through token sales, presenting an exclusive investment prospect within the cryptocurrency market. Token purchasers are anticipated to derive profits from the model’s employment, establishing a self-sustaining financial cycle that fosters continuous growth and innovation. This approach not only provides the required funding but also aligns investor interests with the project’s prosperity.

Leveraging Expertise in AI and Blockchain

The team behind Near Protocol boasts a rich background in their respective fields, making significant contributions to this venture. Illia Polosukhin, one of the co-founders, was instrumental in the influential research paper titled “Attention Is All You Need,” which paved the way for AI models like ChatGPT. His extensive knowledge of artificial intelligence frameworks is matched by Alex Skidanov’s experience at OpenAI during the creation of ChatGPT. This dual expertise places Near Protocol strategically at the intersection of AI and blockchain technology.

Addressing Technical Challenges

Building a model of such magnitude encounters substantial technical barriers, particularly in relation to computational power. Typically, training models this large necessitates the use of centralized clusters consisting of tens of thousands of GPUs. These clusters can be difficult to manage logistically and financially expensive. However, Near Protocol is investigating decentralized training techniques, borrowing ideas from pioneering research institutions like DeepMind, to distribute the computational burden across a network. This method could potentially make AI development more accessible and lessen our dependence on centralized infrastructure.

Decentralization and Privacy Considerations

At the heart of Near Protocol’s beliefs lies the principle of decentralization, which is also a key aspect of their AI project. By employing encrypted Trusted Execution Environments, the goal is twofold: safeguarding user privacy and guaranteeing secure and verifiable contributions. This strategy not only shields sensitive information but also encourages ongoing updates and enhancements to the model, thereby cultivating a flexible and adaptive AI environment that thrives on continuous progress.

Implications for the AI and Blockchain Sectors

As a researcher delving into the realm of technological innovation, I find myself captivated by Near Protocol’s ambitious endeavor that seamlessly blends AI and blockchain technologies. This open-source project has the potential to democratize access to sophisticated AI capabilities, thereby broadening the scope of applications and fostering a wealth of innovations. Furthermore, the incorporation of blockchain for funding and governance offers a fresh perspective on AI development, potentially paving the way for future industry projects to follow suit.

The ambition of Near Protocol to construct an expansive 1.4 trillion parameter open-source AI model underscores the promise of collaborative progress at the junction of artificial intelligence (AI) and blockchain technology. By utilizing decentralized development, pioneering financing methods, and a focus on privacy, this endeavor could serve as a trailblazer for future AI developments that are more open and transparent. As the project unfolds, it will attract attention from both the AI and blockchain communities, showcasing the transformative potential when these technologies merge.

 

Read More

2024-11-12 15:40