Dataset: Tracking Compute-Intensive AI Models

About this Dataset

Tracking Compute-Intensive AI Models

A dataset that tracks compute-intensive AI models, with training compute over 10²³ floating point operations (FLOP). This corresponds to training costs of hundreds of thousands of dollars or more.

To identify compute-intensive AI models, the team at Epoch AI used various resources, estimating compute when not directly reported. They included benchmarks and repositories, such as Papers With Code and Hugging Face, to find models exceeding 10²³ FLOP. They also explored non-English media and specific leaderboards, particularly focusing on Chinese sources.

Additionally, they examined blog posts, press releases from major labs, and scholarly literature to track new models. A separate table was created for models with unconfirmed but plausible compute levels. Despite thorough methods, proprietary and secretive models may have been missed.

Tables

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_1

10.49 KB
81 rows
8 columns


CREATE TABLE owid_epoch_compute_intensive_1 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "organization_categorization" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_2

12.92 KB
209 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_2 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" FLOAT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_3

12.91 KB
212 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_3 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" FLOAT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_4

13.16 KB
219 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_4 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" FLOAT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_5

13.59 KB
223 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_5 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_6

14.29 KB
244 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_6 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_7

14.71 KB
258 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_7 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_8

15.29 KB
276 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_8 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_9

17.38 KB
353 rows
7 columns


CREATE TABLE owid_epoch_compute_intensive_9 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);