EXTENDED TEST DATA SET FOR THE PAPER ``NEER: An Unsupervised
	   Method for Named Entity Evolution Recognition''

These files form the extended test data set for the paper ``NEER: An
Unsupervised Method for Named Entity Evolution Recognition'' by
N. Tahmasebi et al. They can be used to evaluate systems that detect
named entity changes over time.

This set contains name pairs that were not used for the evalution in
the paper because the change occurs outside of the time range of the
corpus or because the corpus has too few occurrences of the name.

The following files are contained in this archive:

    companynames.txt
    locations.txt
    organizations.txt
    persons.txt
    technology.txt

	temporal co-references for named entities from the classes
	company names, locations, (political) organizations, persons
	and technology.  There are a total of 294 co-references, 167
	direct and 127 indirect. These correspond to 75 distinct
	entities.

	The format is described below in section 1 ``Co-Reference File
	Format''.

    changes.csv

	Known periods of change for the given entities. The format of
	this file is described below in section 2 ``Changes File
	Format''.

1. Co-Reference File Format
======================

Each file consists of blocks of co-reference for the same query
term. Each block is separated by a blank line.

Co-reference lines have the following format:

query term \t co-reference \t class \n

i.e. each column is separated by a TAB character. The class column has
one of the following values:

     2 	  for temporal co-references, i.e. names that are used only for
     	  some periods of the dataset

     1 	  for additional terms used to refer to the entitiy,
          e.g. `musician'


2. Changes File Format
======================

The file changes.csv gives the known change periods (given as the year
of change) for the tested entities. Each line has the format:

query term \t year \n

Note that there may be several change periods for the same entity.


3. Using This Data Set
======================

You are allowed to use this data set to develop, test, and evaluate
your own systems. If you publish your results, please cite this data
set as

    N. Tahmasebi et al.: NEER: An Unsupervised Method for Named Entity Evolution Recognition. In: COLING 2012, pp XXX--XXX.

and send us an email at <nina@tahmasebi.se>.

If you have any questions or want to suggest any additional queries,
please contact us at  <nina@tahmasebi.se>.