Anthropic – potential rival to OpenAI

[wjfox]

Anthropic’s $5B, 4-year plan to take on OpenAI

10:25 PM GMT+1•April 6, 2023

AI research startup Anthropic aims to raise as much as $5 billion over the next two years to take on rival OpenAI and enter over a dozen major industries, according to company documents obtained by TechCrunch.

A pitch deck for Anthropic’s Series C fundraising round discloses these and other long-term goals for the company, which was founded in 2020 by former OpenAI researchers.

[...]

Anthropic estimates its frontier model will require on the order of 10^25 FLOPs, or floating point operations — several orders of magnitude larger than even the biggest models today. Of course, how this translates to computation time depends on the speed and scale of the system doing the computation; Anthropic implies (in the deck) it relies on clusters with “tens of thousands of GPUs.”

This frontier model could be used to build virtual assistants that can answer emails, perform research and generate art, books and more, some of which we have already gotten a taste of with the likes of GPT-4 and other large language models.

“These models could begin to automate large portions of the economy,” the pitch deck reads. “We believe that companies that train the best 2025/26 models will be too far ahead for anyone to catch up in subsequent cycles.”

https://techcrunch.com/2023/04/06/anthr ... on-openai/

[wjfox]

Introducing 100K Context Windows

May 11, 2023

We’ve expanded Claude’s context window from 9K to 100K tokens, corresponding to around 75,000 words! This means businesses can now submit hundreds of pages of materials for Claude to digest and analyze, and conversations with Claude can go on for hours or even days.

The average person can read 100,000 tokens of text in ~5+ hours, and then they might need substantially longer to digest, remember, and analyze that information. Claude can now do this in less than a minute. For example, we loaded the entire text of The Great Gatsby into Claude-Instant (72K tokens) and modified one line to say Mr. Carraway was “a software engineer that works on machine learning tooling at Anthropic.” When we asked the model to spot what was different, it responded with the correct answer in 22 seconds.

Beyond just reading long texts, Claude can help retrieve information from the documents that help your business run. You can drop multiple documents or even a book into the prompt and then ask Claude questions that require synthesis of knowledge across many parts of the text. For complex questions, this is likely to work substantially better than vector search based approaches. Claude can follow your instructions and return what you’re looking for, as a human assistant would!

Our partners are excited about what larger context windows means for their business. 100K translates into roughly 6 hours of audio - AssemblyAI put out a great demonstration of this where they transcribed a long podcast into 58K words and then used Claude for summarization and Q&A.

https://www.anthropic.com/index/100k-context-windows

[wjfox]

Claude 2

Jul 11, 2023 ● 4 min read

We are pleased to announce Claude 2, our new model. Claude 2 has improved performance, longer responses, and can be accessed via API as well as a new public-facing beta website, claude.ai. We have heard from our users that Claude is easy to converse with, clearly explains its thinking, is less likely to produce harmful outputs, and has a longer memory. We have made improvements from our previous models on coding, math, and reasoning. For example, our latest model scored 76.5% on the multiple choice section of the Bar exam, up from 73.0% with Claude 1.3. When compared to college students applying to graduate school, Claude 2 scores above the 90th percentile on the GRE reading and writing exams, and similarly to the median applicant on quantitative reasoning.

Think of Claude as a friendly, enthusiastic colleague or personal assistant who can be instructed in natural language to help you with many tasks. The Claude 2 API for businesses is being offered for the same price as Claude 1.3. Additionally, anyone in the US and UK can start using our beta chat experience today.

As we work to improve both the performance and safety of our models, we have increased the length of Claude’s input and output. Users can input up to 100K tokens in each prompt, which means that Claude can work over hundreds of pages of technical documentation or even a book. Claude can now also write longer documents - from memos to letters to stories up to a few thousand tokens - all in one go.

In addition, our latest model has greatly improved coding skills. Claude 2 scored a 71.2% up from 56.0% on the Codex HumanEval, a Python coding test. On GSM8k, a large set of grade-school math problems, Claude 2 scored 88.0% up from 85.2%. We have an exciting roadmap of capability improvements planned for Claude 2 and will be slowly and iteratively deploying them in the coming months.

We've been iterating to improve the underlying safety of Claude 2, so that it is more harmless and harder to prompt to produce offensive or dangerous output. We have an internal red-teaming evaluation that scores our models on a large representative set of harmful prompts, using an automated test while we also regularly check the results manually. In this evaluation, Claude 2 was 2x better at giving harmless responses compared to Claude 1.3. Although no model is immune from jailbreaks, we’ve used a variety of safety techniques (which you can read about here and here), as well as extensive red-teaming, to improve its outputs.

https://www.anthropic.com/index/claude-2

[weatheriscool]

Amazon is investing up to $4 billion in AI startup Anthropic in growing tech battle
Source: AP

By The Associated Press
Updated 5:41 AM CDT, September 25, 2023

Amazon is investing up to $4 billion in Anthropic and taking a minority stake in the artificial intelligence startup, the two companies said Monday.

The investment underscores how Big Tech companies are pouring money into AI as they race to capitalize on the opportunities that the latest generation of the technology is set to fuel.

Amazon and Anthropic said the deal is part of a broader collaboration to develop so-called foundation models, which underpin the generative AI systems that have captured global attention.

Foundation models, also known as large language models, are trained on vast pools of online information, like blog posts, digital books, scientific articles and pop songs to generate text, images and video that resemble human work.

Read more: https://apnews.com/article/artificial-i ... 50628e7ded

[firestar464]

f*ck now I'll have to refrain from using Anthropic's products when they come to my country because of Amazon.

#MakeAmazonPay

[wjfox]

Anthropic in Talks to Raise $2 Billion From Google and Others Just Days After Amazon Investment

Oct. 3, 2023 3:17 PM PDT

Anthropic, one of the main rivals of OpenAI, is in talks with investors to raise at least $2 billion in new funding, following a commitment from Amazon last week to invest $1.25 billion in the company, according to three people with direct knowledge. Anthropic has told investors that Google, which bought a roughly 10% stake in the startup in 2022, is expected to invest in the round, two of the people said.

The 2-year-old startup, which sells Claude, a chatbot that competes with OpenAI’s ChatGPT, wants a valuation between $20 billion to $30 billion including the new investment, according to one of those people. That would quintuple the valuation of the company since March, when investors put a $4 billion price tag on the firm, and make its shares far pricier than those of OpenAI in terms of its valuation multiple on revenue.

https://www.theinformation.com/articles ... ccelerates

[wjfox]

Google Invests In Anthropic For $2 Billion As AI Race Heats Up

Oct 31, 2023,12:40pm EDT

– Google has announced a $2 billion investment into Anthropic, adding to its $550 million funding from earlier this year
– Amazon made a similar move just weeks before, announcing a $4 billion investment in the ChatGPT rival
– Google shares closed nearly 2% higher at the news

https://www.forbes.com/sites/qai/2023/1 ... eb6626664e

[Cyber_Rebel]

Introducing Claude 2.1



(Anthropic)

Our latest model, Claude 2.1, is now available over API in our Console and is powering our claude.ai chat experience. Claude 2.1 delivers advancements in key capabilities for enterprises—including an industry-leading 200K token context window, significant reductions in rates of model hallucination, system prompts and our new beta feature: tool use. We are also updating our pricing to improve cost efficiency for our customers across models.

200K Context Window

... we’re doubling the amount of information you can relay to Claude with a limit of 200,000 tokens, translating to roughly 150,000 words, or over 500 pages of material. Our users can now upload technical documentation like entire codebases, financial statements like S-1s, or even long literary works like The Iliad or The Odyssey.

2x Decrease in Hallucination Rates

Claude 2.1 has also made significant gains in honesty, with a 2x decrease in false statements compared to our previous Claude 2.0 model. This enables enterprises to build high-performing AI applications that solve concrete business problems and deploy AI across their operations with greater trust and reliability.

API Tool Use

By popular demand, we’ve also added tool use, a new beta feature that allows Claude to integrate with users' existing processes, products, and APIs. This expanded interoperability aims to make Claude more useful across our users’ day-to-day operations.

Claude can now orchestrate across developer-defined functions or APIs, search over web sources, and retrieve information from private knowledge bases. Users can define a set of tools for Claude to use and specify a request. The model will then decide which tool is required to achieve the task and execute an action on their behalf.

[spryfusion]

Blog post: https://www.anthropic.com/news/claude-3-family

[firestar464]

Assuming this is true...

https://openai.com/charter

"Therefore, if a value-aligned, safety-conscious project comes close to building AGI before we do, we commit to stop competing with and start assisting this project."