cross-posted from: https://lemmy.sdf.org/post/28980041

> Australia has banned DeepSeek from all government devices and systems over what it says is the security risk the Chinese artificial intelligence (AI) startup poses. > > ... > > Growing - and familiar - concerns > > Western countries have a track record of being suspicious of Chinese tech - notably telecoms firm Huawei and the social media platform, TikTok - both of which have been restricted on national security grounds. > > ... > > An Australian science minister previously said in January that countries needed to be "very careful" about DeepSeek, citing "data and privacy" concerns. > > The chatbot was removed from app stores after its privacy policy was questioned in Italy. The Italian goverment previously temporarily blocked ChatGPT over privacy concerns in March 2023. > > Regulators in South Korea, Ireland and France have all begun investigations into how DeepSeek handles user data, which it stores in servers in China. > > ... > > Generally, AI tools will analyse the prompts sent to them to improve their product. > > This is true of apps such as ChatGPT and Google Gemini as much as it is DeepSeek. > > All of them gather and keep information, including email addresses and dates of birth. > > ...

cross-posted from: https://lemmy.sdf.org/post/28980151

> cross-posted from: https://lemmy.sdf.org/post/28980041 > > > Australia has banned DeepSeek from all government devices and systems over what it says is the security risk the Chinese artificial intelligence (AI) startup poses. > > > > ... > > > > Growing - and familiar - concerns > > > > Western countries have a track record of being suspicious of Chinese tech - notably telecoms firm Huawei and the social media platform, TikTok - both of which have been restricted on national security grounds. > > > > ... > > > > An Australian science minister previously said in January that countries needed to be "very careful" about DeepSeek, citing "data and privacy" concerns. > > > > The chatbot was removed from app stores after its privacy policy was questioned in Italy. The Italian goverment previously temporarily blocked ChatGPT over privacy concerns in March 2023. > > > > Regulators in South Korea, Ireland and France have all begun investigations into how DeepSeek handles user data, which it stores in servers in China. > > > > ... > > > > Generally, AI tools will analyse the prompts sent to them to improve their product. > > > > This is true of apps such as ChatGPT and Google Gemini as much as it is DeepSeek. > > > > All of them gather and keep information, including email addresses and dates of birth. > > > > ...

cross-posted from: https://lemmy.sdf.org/post/28980041

> Australia has banned DeepSeek from all government devices and systems over what it says is the security risk the Chinese artificial intelligence (AI) startup poses. > > ... > > Growing - and familiar - concerns > > Western countries have a track record of being suspicious of Chinese tech - notably telecoms firm Huawei and the social media platform, TikTok - both of which have been restricted on national security grounds. > > ... > > An Australian science minister previously said in January that countries needed to be "very careful" about DeepSeek, citing "data and privacy" concerns. > > The chatbot was removed from app stores after its privacy policy was questioned in Italy. The Italian goverment previously temporarily blocked ChatGPT over privacy concerns in March 2023. > > Regulators in South Korea, Ireland and France have all begun investigations into how DeepSeek handles user data, which it stores in servers in China. > > ... > > Generally, AI tools will analyse the prompts sent to them to improve their product. > > This is true of apps such as ChatGPT and Google Gemini as much as it is DeepSeek. > > All of them gather and keep information, including email addresses and dates of birth. > > ...

Australia has banned DeepSeek from all government devices and systems over what it says is the security risk the Chinese artificial intelligence (AI) startup poses.

...

Growing - and familiar - concerns

Western countries have a track record of being suspicious of Chinese tech - notably telecoms firm Huawei and the social media platform, TikTok - both of which have been restricted on national security grounds.

...

An Australian science minister previously said in January that countries needed to be "very careful" about DeepSeek, citing "data and privacy" concerns.

The chatbot was removed from app stores after its privacy policy was questioned in Italy. The Italian goverment previously temporarily blocked ChatGPT over privacy concerns in March 2023.

Regulators in South Korea, Ireland and France have all begun investigations into how DeepSeek handles user data, which it stores in servers in China.

...

Generally, AI tools will analyse the prompts sent to them to improve their product.

This is true of apps such as ChatGPT and Google Gemini as much as it is DeepSeek.

All of them gather and keep information, including email addresses and dates of birth.

...

cross-posted from: https://lemmy.sdf.org/post/28978937

> There’s an idea floating around that DeepSeek’s well-documented censorship only exists at its application layer but goes away if you run it locally (that means downloading its AI model to your computer). > > But DeepSeek’s censorship is baked-in, according to a Wired investigation which found that the model is censored on both the application and training levels. > > For example, a locally run version of DeepSeek revealed to Wired thanks to its reasoning feature that it should “avoid mentioning” events like the Cultural Revolution and focus only on the “positive” aspects of the Chinese Communist Party. > > A quick check by TechCrunch of a locally run version of DeepSeek available via Groq also showed clear censorship: DeepSeek happily answered a question about the Kent State shootings in the U.S., but replied “I cannot answer” when asked about what happened in Tiananmen Square in 1989.

cross-posted from: https://lemmy.sdf.org/post/28978937

> There’s an idea floating around that DeepSeek’s well-documented censorship only exists at its application layer but goes away if you run it locally (that means downloading its AI model to your computer). > > But DeepSeek’s censorship is baked-in, according to a Wired investigation which found that the model is censored on both the application and training levels. > > For example, a locally run version of DeepSeek revealed to Wired thanks to its reasoning feature that it should “avoid mentioning” events like the Cultural Revolution and focus only on the “positive” aspects of the Chinese Communist Party. > > A quick check by TechCrunch of a locally run version of DeepSeek available via Groq also showed clear censorship: DeepSeek happily answered a question about the Kent State shootings in the U.S., but replied “I cannot answer” when asked about what happened in Tiananmen Square in 1989.

There’s an idea floating around that DeepSeek’s well-documented censorship only exists at its application layer but goes away if you run it locally (that means downloading its AI model to your computer).

But DeepSeek’s censorship is baked-in, according to a Wired investigation which found that the model is censored on both the application and training levels.

For example, a locally run version of DeepSeek revealed to Wired thanks to its reasoning feature that it should “avoid mentioning” events like the Cultural Revolution and focus only on the “positive” aspects of the Chinese Communist Party.

A quick check by TechCrunch of a locally run version of DeepSeek available via Groq also showed clear censorship: DeepSeek happily answered a question about the Kent State shootings in the U.S., but replied “I cannot answer” when asked about what happened in Tiananmen Square in 1989.

cross-posted from: https://lemmy.sdf.org/post/28977775

> In the European Union (EU), 47% of electricity now comes from renewable sources like wind and solar, a new record according to a report from the think tank Ember. This is a far higher percentage than in other countries, including the United States and China, where about two-thirds of energy comes from fossil fuels such as oil, coal, and gas. > > For the first time in 2024, solar energy surpassed coal in generating electricity across all 27 EU member states, while natural gas production of electricity fell for the fifth year running. > > Climate change experts are encouraged by Europe’s continued push toward cleaner energy, especially as the new U.S. administration pushes for increased fossil fuel use. > > “Fossil fuels are losing their grip on EU energy,” said Chris Rosslowe, the lead author of Ember’s ‘European Electricity Review’. “Back in 2019, at the start of the European Green Deal, few believed the energy transition would be where it is today: wind and solar are replacing coal and driving gas into a structural decline.” > > The share of electricity produced by renewables jumped to 47% last year compared to 34% in 2019, in large part due to strong growth in solar and wind energy. In 2024, 11% of the EU’s electricity came from solar power, 17% from wind, and 24% from nuclear. The share produced by traditional fossil fuels dropped from 39% in 2019 to 29% in 2024. > > ...

[Edit typo.]

cross-posted from: https://lemmy.sdf.org/post/28977775

> In the European Union (EU), 47% of electricity now comes from renewable sources like wind and solar, a new record according to a report from the think tank Ember. This is a far higher percentage than in other countries, including the United States and China, where about two-thirds of energy comes from fossil fuels such as oil, coal, and gas. > > For the first time in 2024, solar energy surpassed coal in generating electricity across all 27 EU member states, while natural gas production of electricity fell for the fifth year running. > > Climate change experts are encouraged by Europe’s continued push toward cleaner energy, especially as the new U.S. administration pushes for increased fossil fuel use. > > “Fossil fuels are losing their grip on EU energy,” said Chris Rosslowe, the lead author of Ember’s ‘European Electricity Review’. “Back in 2019, at the start of the European Green Deal, few believed the energy transition would be where it is today: wind and solar are replacing coal and driving gas into a structural decline.” > > The share of electricity produced by renewables jumped to 47% last year compared to 34% in 2019, in large part due to strong growth in solar and wind energy. In 2024, 11% of the EU’s electricity came from solar power, 17% from wind, and 24% from nuclear. The share produced by traditional fossil fuels dropped from 39% in 2019 to 29% in 2024. > > ...

[Edit typo.]

In the European Union (EU), 47% of electricity now comes from renewable sources like wind and solar, a new record according to a report from the think tank Ember. This is a far higher percentage than in other countries, including the United States and China, where about two-thirds of energy comes from fossil fuels such as oil, coal, and gas.

For the first time in 2024, solar energy surpassed coal in generating electricity across all 27 EU member states, while natural gas production of electricity fell for the fifth year running.

Climate change experts are encouraged by Europe’s continued push toward cleaner energy, especially as the new U.S. administration pushes for increased fossil fuel use.

“Fossil fuels are losing their grip on EU energy,” said Chris Rosslowe, the lead author of Ember’s ‘European Electricity Review’. “Back in 2019, at the start of the European Green Deal, few believed the energy transition would be where it is today: wind and solar are replacing coal and driving gas into a structural decline.”

The share of electricity produced by renewables jumped to 47% last year compared to 34% in 2019, in large part due to strong growth in solar and wind energy. In 2024, 11% of the EU’s electricity came from solar power, 17% from wind, and 24% from nuclear. The share produced by traditional fossil fuels dropped from 39% in 2019 to 29% in 2024.

...

[Edit typo.]

cross-posted from: https://lemmy.sdf.org/post/28973386

> Archived > > An Australian economist has argued China has “hoodwinked” the world on net zero in what he acknowledges could be seen as a “controversial” take. > > Leith Van Onselen, chief economist at the MB Fund and MB Super and co-founder of MacroBusiness, told 4BC host Mike Jeffreys that while Australia and other countries are making sacrifices for the good of the planet, the world’s biggest greenhouse gas emitter is not, and therefore “we’re basically shooting ourselves in the foot”. > > “I’d argue China is the largest beneficiary of the West’s net zero policies,” Mr Van Onselen said on the radio show. > > “It’s not abiding by the same rules and what we’re effectively doing is, while we’re reducing our carbon footprints through these sorts of policies and giving us expensive energy and shutting down manufacturing and becoming less diversified economies, China is simply expanding its carbon output and expanding its manufacturing sector at our expense. > > “The world’s not getting cleaner. We’re just shifting the pollution away from us, to China, and it’s actually less regulated in China.” > > ... > > He referred to a Reuters report from August that found China had boosted domestic coal production and imports to record highs. > > It said production from China’s mines hit a seasonal record of 390 million tonnes in July 2024, up from 378 million in the same month a year earlier, and imports surged to a seasonal record of 296 million tonnes in the first seven months from 261 million tonnes in 2023. > > Mr Van Onselen concluded: “I think we can all agree we’d like to have a cleaner planet but the whole idea of net zero is completely impossible or ridiculous if China is not involved. > > “If we’re going to make sacrifices, China has to make sacrifices.”

As the European Union suspended visa-free travel to the Schengen area for Georgian travelers with diplomatic and official passports, “Norway will consider taking parallel steps,” the country’s Foreign Ministry said in its February 3 statement.

The statement recalls the October 26 elections that were marred by “widespread irregularities,” then mentions the November 28 decision by the Georgian Dream government to abandon EU accession efforts, followed by non-stop protests. It highlights the authorities’ “brutal violence” against demonstrators, including at the recent February 2 protest at the entrance to Tbilisi. ...

The EU suspended visa-free regime for Georgian diplomatic and service passport holders on January 27. This “will be followed up by parallel steps by Norway,” the statement says.

Although the authorities can no longer enter the Schengen area without a visa with diplomatic passports, they can do so with ordinary passports, which they also possess. There have been calls for the EU not to leave this loophole to the authorities and to draw up a list of individuals who should be individually banned from entering the EU without a visa, even with ordinary passports.

cross-posted from: https://lemmy.sdf.org/post/28973386

> Archived > > An Australian economist has argued China has “hoodwinked” the world on net zero in what he acknowledges could be seen as a “controversial” take. > > Leith Van Onselen, chief economist at the MB Fund and MB Super and co-founder of MacroBusiness, told 4BC host Mike Jeffreys that while Australia and other countries are making sacrifices for the good of the planet, the world’s biggest greenhouse gas emitter is not, and therefore “we’re basically shooting ourselves in the foot”. > > “I’d argue China is the largest beneficiary of the West’s net zero policies,” Mr Van Onselen said on the radio show. > > “It’s not abiding by the same rules and what we’re effectively doing is, while we’re reducing our carbon footprints through these sorts of policies and giving us expensive energy and shutting down manufacturing and becoming less diversified economies, China is simply expanding its carbon output and expanding its manufacturing sector at our expense. > > “The world’s not getting cleaner. We’re just shifting the pollution away from us, to China, and it’s actually less regulated in China.” > > ... > > He referred to a Reuters report from August that found China had boosted domestic coal production and imports to record highs. > > It said production from China’s mines hit a seasonal record of 390 million tonnes in July 2024, up from 378 million in the same month a year earlier, and imports surged to a seasonal record of 296 million tonnes in the first seven months from 261 million tonnes in 2023. > > Mr Van Onselen concluded: “I think we can all agree we’d like to have a cleaner planet but the whole idea of net zero is completely impossible or ridiculous if China is not involved. > > “If we’re going to make sacrifices, China has to make sacrifices.”

cross-posted from: https://lemmy.sdf.org/post/28973386

> Archived > > An Australian economist has argued China has “hoodwinked” the world on net zero in what he acknowledges could be seen as a “controversial” take. > > Leith Van Onselen, chief economist at the MB Fund and MB Super and co-founder of MacroBusiness, told 4BC host Mike Jeffreys that while Australia and other countries are making sacrifices for the good of the planet, the world’s biggest greenhouse gas emitter is not, and therefore “we’re basically shooting ourselves in the foot”. > > “I’d argue China is the largest beneficiary of the West’s net zero policies,” Mr Van Onselen said on the radio show. > > “It’s not abiding by the same rules and what we’re effectively doing is, while we’re reducing our carbon footprints through these sorts of policies and giving us expensive energy and shutting down manufacturing and becoming less diversified economies, China is simply expanding its carbon output and expanding its manufacturing sector at our expense. > > “The world’s not getting cleaner. We’re just shifting the pollution away from us, to China, and it’s actually less regulated in China.” > > ... > > He referred to a Reuters report from August that found China had boosted domestic coal production and imports to record highs. > > It said production from China’s mines hit a seasonal record of 390 million tonnes in July 2024, up from 378 million in the same month a year earlier, and imports surged to a seasonal record of 296 million tonnes in the first seven months from 261 million tonnes in 2023. > > Mr Van Onselen concluded: “I think we can all agree we’d like to have a cleaner planet but the whole idea of net zero is completely impossible or ridiculous if China is not involved. > > “If we’re going to make sacrifices, China has to make sacrifices.”

Archived

An Australian economist has argued China has “hoodwinked” the world on net zero in what he acknowledges could be seen as a “controversial” take.

Leith Van Onselen, chief economist at the MB Fund and MB Super and co-founder of MacroBusiness, told 4BC host Mike Jeffreys that while Australia and other countries are making sacrifices for the good of the planet, the world’s biggest greenhouse gas emitter is not, and therefore “we’re basically shooting ourselves in the foot”.

“I’d argue China is the largest beneficiary of the West’s net zero policies,” Mr Van Onselen said on the radio show.

“It’s not abiding by the same rules and what we’re effectively doing is, while we’re reducing our carbon footprints through these sorts of policies and giving us expensive energy and shutting down manufacturing and becoming less diversified economies, China is simply expanding its carbon output and expanding its manufacturing sector at our expense.

“The world’s not getting cleaner. We’re just shifting the pollution away from us, to China, and it’s actually less regulated in China.”

...

He referred to a Reuters report from August that found China had boosted domestic coal production and imports to record highs.

It said production from China’s mines hit a seasonal record of 390 million tonnes in July 2024, up from 378 million in the same month a year earlier, and imports surged to a seasonal record of 296 million tonnes in the first seven months from 261 million tonnes in 2023.

Mr Van Onselen concluded: “I think we can all agree we’d like to have a cleaner planet but the whole idea of net zero is completely impossible or ridiculous if China is not involved.

“If we’re going to make sacrifices, China has to make sacrifices.”

...

Seit Dienstantritt [in seiner Schule] habe Michael Z. aber „in Wort und Tat nicht den geringsten Zweifel daran aufkommen lassen, dass er mit inakzeptablen Einstellungen und Aktivitäten in seiner Jugend/Studentenzeit gebrochen hat, davon gebührend Abstand hält“, so der Schulleiter.

Michael Z. selbst antwortete auf eine taz-Anfrage nicht. Eine öffentliche Erklärung zu seinem Szeneausstieg ist nicht bekannt. Und auch die Mitgliedschaft in einer Burschenschaft gilt eigentlich auf Lebenszeit. Die „Raczek“-Burschenschaft ließ eine Anfrage unbeantwortet, ob Michael Z. bei ihnen noch Mitglied ist.

Der Klimaaktivistin Lisa Poettinger wirft das von den Freien Wählern geführte Kultusministerium dagegen die Mitgliedschaft im „Offenen Antikapitalistischen Klimatreffen München“ vor, das vom Verfassungsschutz als extremistisch eingestuft wird.

Verwiesen wird auch auf ihre Kapitalismuskritik bei Protesten gegen die Automesse IAA. Und auf laufende Strafverfahren wegen eines zerstörten AfD-Plakats und Widerstand gegen einen Polizisten bei der Besetzung des Dorfes Lützeraths, das für einen Kohletagebau geräumt wurde. Urteile sind hier jedoch noch nicht gefallen. Poettinger hatte angekündigt, sich juristisch gegen eine Nichtzulassung zum Referendariat wehren zu wollen.

cross-posted from: https://lemmy.sdf.org/post/28971543

> Archived > > DeepSeek is said to have access to tens of thousands of GPU accelerators for the development of its own AI models, including H100 GPUs, which fall under the US export bans. The reported costs of just under 5.6 million US dollars for DeepSeek v3 probably only represent a small part of the total bill. > > In the paper on the V3 model, DeepSeek writes of a comparatively small data center with 2048 H800 accelerators from Nvidia. The company calculates hypothetical rental costs of 2 US dollars per hour and H800 GPU. With a total of just under 2.8 million computing hours (distributed across 2048 GPUs), this comes to 5.6 million US dollars. > > However, the developers themselves cite a caveat: "Please note that the above costs only include the official training of DeepSeek-V3 and not the costs associated with previous research and ablation experiments on architectures, algorithms or data." > > ... > > Semianalysis has looked at a realistic cost breakdown. According to the analysts, DeepSeek has access to about 60,000 Nvidia accelerators through its parent company High-Flyer: 10,000 A100s from the Ampere generation before the US export restrictions came into effect, 10,000 H100s from the gray market, 10,000 H800s customized for China, and 30,000 H20s that Nvidia launched after more recent export restrictions. > > ... > > Semianalysis calculates that the servers required for the 60,000 GPUs cost around 1.6 billion US dollars. The operating costs are on top of that. This does not include the salaries of the development teams. > > According to DeepSeek, 96 percent of the 5.6 million US dollars quoted is for pre-training. This involves training the final underlying model. The paper ignores the previous development effort, including all the innovations incorporated into DeepSeek V2.

Archiv-Link

DeepSeek soll Zugriff auf Zehntausende GPU-Beschleuniger zur Entwicklung der eigenen KI-Modelle haben, darunter auch H100-GPUs, die unter die US-Exportverbote fallen. Die kolportierten Kosten von knapp 5,6 Millionen US-Dollar für DeepSeek v3 stellen vermutlich nur einen kleinen Teil der Gesamtrechnung dar.

Im Paper zum V3-Modell schreibt DeepSeek von einem vergleichsweise kleinen Rechenzentrum mit 2048 H800-Beschleunigern von Nvidia. Die Firma rechnet mit hypothetischen Mietkosten von 2 US-Dollar pro Stunde und H800-GPU. Bei aufsummiert knapp 2,8 Millionen Rechenstunden (verteilt auf 2048 GPUs) kommen die 5,6 Millionen US-Dollar zustande.

Die Entwickler selbst führen allerdings eine Einschränkung an: "Bitte beachte, dass die oben genannten Kosten nur das offizielle Training von DeepSeek-V3 beinhalten und nicht die Kosten, die mit früheren Forschungs- und Ablationsexperimenten zu Architekturen, Algorithmen oder Daten verbunden sind."

...

Semianalysis hat sich mit einer realistischen Kostenaufstellung beschäftigt. Laut den Analysten hat DeepSeek über das Mutterunternehmen High-Flyer Zugriff auf etwa 60.000 Nvidia-Beschleuniger: 10.000 A100 aus der Ampere-Generation, bevor die US-Exportbeschränkungen in Kraft traten, 10.000 H100 vom Graumarkt, 10.000 für China angepasste H800 und 30.000 H20, die Nvidia nach neueren Exporteinschränkungen auflegte.

...

Allein die Entwicklung der Caching-Technik Multi-Head Latent Attention (MLA) soll Monate beansprucht haben. Dabei komprimiert das KI-Modell alle generierten Token, damit es bei neuen Abfragen schnell auf die Daten zugreifen kann, ohne viel Speicherplatz zu beanspruchen.

Eine zweite Neuerung dürfte ebenfalls einige Ressourcen in Anspruch genommen haben: "Dual Pipe". DeepSeek nutzt einen Teil der Streaming-Multiprozessoren (SMs) in Nvidias GPUs als eine Art virtuelle Data Processing Unit (DPU), wie Nextplatform herausstellt. Sie kümmern sich unabhängig vom Prozessor um die Datenbewegungen in und zwischen den KI-Beschleunigern – mit viel geringeren Wartezeiten als beim Einsatz von CPUs, was die Effizienz steigert.

Im Paper zum mächtigeren R1-Modell macht DeepSeek keinerlei Angaben zur eingesetzten Hardware. Hier wäre der Einsatz eines kleinen Rechenzentrums noch unglaubwürdiger. Ausgehend von einem X-Beitrag häuften sich zuletzt Meldungen, dass DeepSeek für R1 auch KI-Beschleuniger von Huawei verwenden könnte.

cross-posted from: https://lemmy.sdf.org/post/28971543

> Archived > > DeepSeek is said to have access to tens of thousands of GPU accelerators for the development of its own AI models, including H100 GPUs, which fall under the US export bans. The reported costs of just under 5.6 million US dollars for DeepSeek v3 probably only represent a small part of the total bill. > > In the paper on the V3 model, DeepSeek writes of a comparatively small data center with 2048 H800 accelerators from Nvidia. The company calculates hypothetical rental costs of 2 US dollars per hour and H800 GPU. With a total of just under 2.8 million computing hours (distributed across 2048 GPUs), this comes to 5.6 million US dollars. > > However, the developers themselves cite a caveat: "Please note that the above costs only include the official training of DeepSeek-V3 and not the costs associated with previous research and ablation experiments on architectures, algorithms or data." > > ... > > Semianalysis has looked at a realistic cost breakdown. According to the analysts, DeepSeek has access to about 60,000 Nvidia accelerators through its parent company High-Flyer: 10,000 A100s from the Ampere generation before the US export restrictions came into effect, 10,000 H100s from the gray market, 10,000 H800s customized for China, and 30,000 H20s that Nvidia launched after more recent export restrictions. > > ... > > Semianalysis calculates that the servers required for the 60,000 GPUs cost around 1.6 billion US dollars. The operating costs are on top of that. This does not include the salaries of the development teams. > > According to DeepSeek, 96 percent of the 5.6 million US dollars quoted is for pre-training. This involves training the final underlying model. The paper ignores the previous development effort, including all the innovations incorporated into DeepSeek V2.

Archived

DeepSeek is said to have access to tens of thousands of GPU accelerators for the development of its own AI models, including H100 GPUs, which fall under the US export bans. The reported costs of just under 5.6 million US dollars for DeepSeek v3 probably only represent a small part of the total bill.

In the paper on the V3 model, DeepSeek writes of a comparatively small data center with 2048 H800 accelerators from Nvidia. The company calculates hypothetical rental costs of 2 US dollars per hour and H800 GPU. With a total of just under 2.8 million computing hours (distributed across 2048 GPUs), this comes to 5.6 million US dollars.

However, the developers themselves cite a caveat: "Please note that the above costs only include the official training of DeepSeek-V3 and not the costs associated with previous research and ablation experiments on architectures, algorithms or data."

...

Semianalysis has looked at a realistic cost breakdown. According to the analysts, DeepSeek has access to about 60,000 Nvidia accelerators through its parent company High-Flyer: 10,000 A100s from the Ampere generation before the US export restrictions came into effect, 10,000 H100s from the gray market, 10,000 H800s customized for China, and 30,000 H20s that Nvidia launched after more recent export restrictions.

...

Semianalysis calculates that the servers required for the 60,000 GPUs cost around 1.6 billion US dollars. The operating costs are on top of that. This does not include the salaries of the development teams.

According to DeepSeek, 96 percent of the 5.6 million US dollars quoted is for pre-training. This involves training the final underlying model. The paper ignores the previous development effort, including all the innovations incorporated into DeepSeek V2.