Baselight

UFO Sighting Full Description

NLP on UFO-Sighting reports

@kaggle.emohamed_ufo_sighting_full_description

Loading...
Loading...

About this Dataset

UFO Sighting Full Description

Context

In NLP sometimes you want data about people talking about the same topic, the topic is very unique and distinguishable, the English used is clean (slang free) and schema-less (unstructured grammatically). I believe that UFO sighting descriptions by people cover all of these points.

Content

I found that the data posted on Kaggle for UFO sighting [1] all focused on geospatial patterns and only includes the first 300 characters or so from every description report. Thus I scraped all 90K reports from their source [2] with the full description of every UFO sighting for NLP.

Acknowledgements

I thank the National UFO Reporting Center (NUFORC) for providing the data and making it easy to scrape too.

Inspiration

I am very curious to see different NLP techniques done on this data, especially unsupervised with BERT embeddings. Also if merged with the one posted by Kaggle [1], it could be used for the classification of UFO sighted "Shape". Furthermore, a supervised experiment which predicts the location of the sighted UFO "State/City/County...etc.) on the same day to confirm that 2 different descriptions were in fact for the same UFO for instance would be very interesting.

References

[1] https://www.kaggle.com/NUFORC/ufo-sightings
[2] http://www.nuforc.org/webreports/ndxevent.html

Tables

@kaggle.emohamed_ufo_sighting_full_description.reports_links
  • 586.15 kB
  • 94,566 rows
  • 2 columns
Loading...
CREATE TABLE reports_links (
  "link" VARCHAR,
  "unnamed_1" VARCHAR  -- Unnamed: 1
);

Ufo Sightingdescription Annotated

@kaggle.emohamed_ufo_sighting_full_description.ufo_sightingdescription_annotated
  • 11.65 MB
  • 95,716 rows
  • 4 columns
Loading...
CREATE TABLE ufo_sightingdescription_annotated (
  "n_0" BIGINT  -- 0,
  "n__translucent_cylindrical_silent_aircraft_seen_near_a_38038068" VARCHAR  -- [\" \u0027Translucent Cylindrical Silent Aircraft Seen Near Asheville North CarolinaI Was Standing On My Deck While Watching A Older Model Mono Wing Aircraft\", \u0027 Do And Practice Barrel Rolls About 1000 Feet Up When Something Else Caught My Vision And I Looked Slightly Downward To See A Translucent Cylinder Heading In An West To East Pattern Flight And As It Entered Rays Of The Sun It Became Visible And Then Would Disappear And Then Become Visible Again As It Hit Another Ray\u0027, \u0027 This Happened Three Times Before It Finally Just Disappeared Into The Blue Sky. It Had No Wings And There Were No Contrails. Also There Was No Sound And This Cylinder I Saw It Was Much Closer Than The Aircraft Doing The Barrel Rolls. I Was Facing South When I Saw This At About 90 Degrees.\u0027],
  "aircraft" VARCHAR,
  "negative" VARCHAR
);

Share link

Anyone who has the link will be able to view this.