.

Task Overview

In this task, you will evaluate a news article and a span of text. Your job will be to determine if the span of text is a reference to an entity.

The Fragment with Span is located at the top of Span and News Article column. This is a brief passage of text from the article that contains a Span. The Span is a string of words that have been identified as a possible reference to an entity. Note: In some cases, the span might not be highlighted in the article, and the Scroll to Span button will not be enabled. In this case, you will need to find the span manually.

If you rate the span as Valid Reference or Part of a Reference, you will next need to rate one or more entities that the span might refer to. The entities are taken from Wikipedia.

For each entity, you will see the title and a description from the Wikipedia article, as well as the rating question, is this entity being referred to in the span?

Key Points

1)Remember that an entity can include any of the following
  • person names (e.g., Barack Obama) and types of people (e.g., child, working parent)
  • professions (e.g., teacher, president, doctor, actor, artist)
  • company or organization names (e.g., Salesforce, USPS, Golden State Warriors, US government) and types of businesses (e.g., banks, restaurants)
  • locations (e.g., New York City, Pacific Northwest) and geographic features(e.g., peninsula, mountain, moon)
  • media titles, including TV shows, movies, books, songs, etc. (e.g., Game of Thrones)
  • physical objects (e.g., desk, book, voting booth)
  • abstract concepts and processes (e.g., voter registration, debt crisis, sanctions, American, habeas corpus, Occam’s Razor)
  • activities, pursuits, or practices (e.g., running, climbing, deadlifting, yoga) including sports (football, basketball, cricket)
  • date units, units of measurement etc. (e.g., “50 Lbs.”, “September 5th”, “from 19962005”)

 

Example

2)Elements such as Ads, Byline information, Copyright/distribution notices, links, embedded text, and Author bios, contact information and social media pages are not considered part of the body of the article. Even if they are highlighted – In these cases the “Span is not part of the article body checkbox” should be selected.

Example

3) If you rate the span as Valid Reference or Part of a Reference, you will next need to rate one or more entities that the span might refer to. The entities are taken from Wikipedia. Be sure to always read the article to ensure you have a full understanding of the article. Just because the words match does not mean that the Wikipedia Description correctly matches the Entity that the article is discussing.

.

4)Spans that only include part of the text of a full span should be rated as Part of a Reference

 

Leave a Reply

Your email address will not be published. Required fields are marked *

Related Post