Baselight

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive

Loading...
Loading...

About this Dataset

Tracking Compute-Intensive AI Models

A dataset that tracks compute-intensive AI models, with training compute over 10²³ floating point operations (FLOP). This corresponds to training costs of hundreds of thousands of dollars or more. 

To identify compute-intensive AI models, the team at Epoch AI used various resources, estimating compute when not directly reported. They included benchmarks and repositories, such as Papers With Code and Hugging Face, to find models exceeding 10²³ FLOP. They also explored non-English media and specific leaderboards, particularly focusing on Chinese sources.

Additionally, they examined blog posts, press releases from major labs, and scholarly literature to track new models. A separate table was created for models with unconfirmed but plausible compute levels. Despite thorough methods, proprietary and secretive models may have been missed.

Tables

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_1
  • 10.49 KB
  • 81 rows
  • 8 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_1 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "organization_categorization" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_2
  • 12.92 KB
  • 209 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_2 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" FLOAT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_3
  • 12.91 KB
  • 212 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_3 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" FLOAT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_4
  • 13.16 KB
  • 219 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_4 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" FLOAT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_5
  • 13.59 KB
  • 223 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_5 (
  "days_since_1949" INTEGER,
  "system" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_6
  • 14.29 KB
  • 244 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_6 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_7
  • 14.71 KB
  • 258 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_7 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_8
  • 15.29 KB
  • 276 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_8 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Tracking Compute-Intensive AI Models

@owid.epoch_compute_intensive.owid_epoch_compute_intensive_9
  • 17.38 KB
  • 353 rows
  • 7 columns
Loading...

CREATE TABLE owid_epoch_compute_intensive_9 (
  "days_since_1949" INTEGER,
  "model" VARCHAR,
  "publication_date" TIMESTAMP,
  "domain" VARCHAR,
  "parameters" BIGINT,
  "training_dataset_size_datapoints" BIGINT,
  "training_computation_petaflop" FLOAT
);

Share link

Anyone who has the link will be able to view this.