The goal of the program is the automatic creation of short (30-50) word summaries of documents in response to a query.
The program can be written in C or C++.
The input to the program will be a query, and a set of text files for the query.
## Deliverables
The goal of the program is the automatic creation of short (30-50) word summaries of documents in response to a query.
Since our system does not do deep natural language understanding we will instead try to generate an extract that has many good qualities:
a. The extract should include the “important?? query words.
b. The “important query words?? should be “close?? to each other.
c. There should be no repetitions
d. If possible the extract should be coherent
e. If possible the extract should indicate the main topic of the document
The program can be written in C or C++.
Please include also a read me file with explanation of how to compile and run the program. The source code must also be explained [login to view URL] also a detailed discussion of the scoring function that was used to generate the extracts. Your program should print the original text, the summary and the score for each of the given text files.
The input to the program will be a query, and a set of text files for the query. An example of a query and some files have been given below.A list of additional questions and text files for each will be provided.
Document 1:
<DOC>
<DOCNO> APW19981017.0507 </DOCNO>
<DOCTYPE> NEWS STORY </DOCTYPE>
<DATE_TIME> 10/17/1998 12:48:00 </DATE_TIME>
<HEADER>
w1371 &Cx1f; wstm-
u i &Cx13; &Cx11; BC-Britain-Pinochet 6thLd 10-17 0105
</HEADER>
<BODY>
<SLUG> BC-Britain-Pinochet, 6th Ld,0105 </SLUG>
<HEADLINE>
British police arrest Pinochet on Spanish warrant
</HEADLINE>
&UR; Eds: RECASTS top two grafs. &QL;
&UR; By SUE LEEMAN &QC;
&UR; Associated Press Writer &QC;
<TEXT>
LONDON (AP) _ Former Chilean dictator Gen. Augusto Pinochet has
been arrested by British police on a Spanish extradition warrant,
despite protests from Chile that he is entitled to diplomatic
immunity.
Two Spanish judges are seeking to question Pinochet about the
slayings of an unspecified number of Spaniards in Chile between
Sept. 11, 1973, the date he seized power, and Dec. 31, 1983. No
reason for the dates was given.
Chile said, graf 3 pvs
</TEXT>
(PROFILE
(WS SL:BC-Britain-Pinochet, 6th Ld; CT:i;
(REG:EURO;)
(REG:BRIT;)
(REG:SCAN;)
(REG:MEST;)
(REG:AFRI;)
(REG:INDI;)
(REG:ENGL;)
(REG:ASIA;)
(LANG:ENGLISH;))
)
</BODY>
<TRAILER>
AP-NY-10-17-98 1248EDT
</TRAILER>
</DOC>
Document 2:
<DOC>
<DOCNO> NYT19981018.0185 </DOCNO>
<DOCTYPE> NEWS STORY </DOCTYPE>
<DATE_TIME> 1998-10-18 21:12 </DATE_TIME>
<HEADER>
A3584 &Cx1f; taf-z
u i &Cx13; &Cx11; BC-PINOCHET-LAW-560&ADD- 10-18 0742
</HEADER>
<BODY>
<SLUG> BC-PINOCHET-LAW-560&ADD-NYT </SLUG>
<HEADLINE>
ACCUSED OFFICIALS HAVE FEWER PLACES TO HIDE
</HEADLINE>
(ATTN: Conn., Tenn.) (See also PINOCHET-CHILE, PINOCHET-BRITAIN, PINOCHET-JUDGE.)
(lb)
By ROBERT PEAR
c.1998 N.Y. Times News Service
<TEXT>
<P>
WASHINGTON _ The arrest of Gen. Augusto Pinochet shows the
growing significance of international human-rights law, suggesting
that officials accused of atrocities have fewer places to hide
these days, even if they are carrying diplomatic passports, legal
scholars say.
</P>
<P>
Pinochet, who ruled Chile as a military dictator from 1973 to
1990, was granted amnesty in his homeland but was arrested on
Friday in London at the request of Spanish authorities, who want
him extradited to Spain.
</P>
<P>
A growing body of international law has in the last 10 years
made it somewhat easier to reach across borders and apprehend
suspects accused of torture, genocide and other ``crimes against
humanity.''
</P>
<P>
A lawyer in Washington who represents victims of the Pinochet
administration, Samuel Buffone, said, ``What is really innovative
and important here is that a Spanish court is looking at
international acts of terrorism, systemic human-rights abuses and
genocide, and is asserting jurisdiction on that basis.''
</P>
<P>
The Spanish authorities contend that Pinochet may have committed
crimes against Spanish citizens in Chile. They said the European
Convention on Terrorism and other treaties required Britain to
extradite Pinochet.
</P>
<P>
``The lesson here is that terrorists will have no safe haven and
are the modern-day equivalent of pirates,'' Buffone said.
``Anywhere they are found on the high seas they will be nabbed and
prosecuted.''
</P>
<P>
Thomas Buergenthal, a professor of international law at George
Washington University here, expressed doubts that Pinochet was
entitled to diplomatic immunity, even though he has a diplomatic
passport.
</P>
<P>
``The fact that he wasn't accredited to Britain and was not in
transit to a diplomatic post,'' Buergenthal said, ``means that
Britain doesn't have to give him diplomatic immunity, unless there
was some prior arrangement to do so.''
</P>
<P>
The case raises many complex legal questions. For example, does
Pinochet have any immunity because of his status as a former head
of state or because of his current status as a ``senator for life''
in Chile? Chile granted him amnesty, but are other countries
required to honor that amnesty? Could Spain try Pinochet for his
actions in Chile?
</P>
<P>
Under the Chilean Constitution, adopted while he was in power,
Pinochet is immune from prosecution there.
</P>
<P>
Professor Lori Damrosch, an expert on international law at
Columbia University, said: ``That doesn't carry any weight outside
Chile. It's not binding on any other country. All these
ex-dictators must have an understanding that they are somewhat at
risk when they leave their own countries.''
</P>
<P>
The ``personal inviolability'' of diplomats is a venerable
privilege that can be traced from the protection accorded to
wartime emissaries in ancient Greece.
</P>
<P>
The Vienna Convention on Diplomatic Relations of 1961 says,
``The purpose of such privileges and immunities is not to benefit
individuals, but to ensure the efficient performance of the
functions of diplomatic missions.''
</P>
<P>
Thus, legal scholars say, diplomatic immunity was not created to
insulate people against prosecution for crimes against humanity or
other atrocities. In recent years courts have shown an increased
willingness to try criminal and civil cases involving contentions
that foreigners committed torture, genocide or war crimes.
</P>
<ANNOTATION>
(STORY CAN END HERE _ OPTIONAL MATERIAL FOLLOWS)
</ANNOTATION>
<P>
Professor Michael Reisman of Yale said: ``In the past a head of
state would have been given broad immunity for acts committed while
he was head of state. But international law has moved steadily in
the direction of assigning personal responsibility to such
officials for grave violations of human rights or the law of war.''
</P>
<P>
Spain's contention that it has the authority to interrogate and
try Pinochet is similar to the United States' argument that it can
try hijackers and terrorists for crimes committed against American
citizens abroad.
</P>
<P>
Professor Jonathan Charney of the Vanderbilt Law School, editor
of The American Journal of International Law, noted that Pinochet
is accused of genocide, torture, and cruel and unusual punishment.
``These are considered universal crimes,'' he said.
</P>
</TEXT>
</BODY>
<TRAILER>
NYT-10-18-98 2112EDT &QL;
</TRAILER>
</DOC>
Document 3:
<DOC>
<DOCNO> APW19981017.0151 </DOCNO>
<DOCTYPE> NEWS STORY </DOCTYPE>
<DATE_TIME> 10/17/1998 05:50:00 </DATE_TIME>
<HEADER>
w2985 &Cx1f; wstm-
r i &Cx13; &Cx11; BC-Britain-Pinochet 10-17 0337
</HEADER>
<BODY>
<SLUG> BC-Britain-Pinochet </SLUG>
<HEADLINE>
Lawmaker: Britain must question Gen. Pinochet about killings,
</HEADLINE>
torture &QL;
<TEXT>
LONDON (AP) _ An influential lawmaker from the governing Labor
Party on Saturday backed Spanish requests to question former
Chilean dictator Gen. Augusto Pinochet, in London for back surgery,
on allegations of genocide and terrorism.
''There've been something like a total of 3,197 cases'' of
murder and torture during Pinochet's 1973-90 regime, Ann Clywd said
in an interview with British Broadcasting Corp. radio.
``In the course of a long search by their relatives, the remains
of some of the disappeared have been discovered in unmarked
graves,'' said Ms. Clywd, who chairs an all-party committee of
lawmakers on human rights. ``And hundreds of former detainees have
made statements confirming that the disappeared were held in
detention centers.''
``Clearly, the Spanish authorities have every right to try and
investigate these matters further.''
Pinochet, 82, who underwent surgery for a herniated disc a week
ago, was reported to have left London Bridge Hospital earlier
Wednesday. British authorities have declined to comment on his
whereabouts or the Spanish requests.
Baltasar Garzon, one of two Spanish magistrates handling probes
into human rights violations in Chile and Argentina, filed a
request to question Pinochet on Wednesday. Another judge, Manuel
Garcia Castellon, filed a request to question Pinochet a day
earlier.
In 1996, Castellon opened his probe into murder, torture and
disappearances in Chile during Pinochet's regime. Garzon is also
investigating the disappearance of hundreds of Spanish citizens in
Argentina during the 1976-83 military dictatorships.
Pinochet, who ousted elected President Salvador Allende in a
bloody 1973 coup, remained commander-in-chief of the Chilean army
until March, when he was sworn in as a senator-for-life, a post
established for him in a constitution drafted by his regime.
(scl)
</TEXT>
(PROFILE
(WS SL:BC-Britain-Pinochet; CT:i;
(REG:EURO;)
(REG:BRIT;)
(REG:SCAN;)
(REG:MEST;)
(REG:AFRI;)
(REG:INDI;)
(REG:ENGL;)
(REG:ASIA;)
(LANG:ENGLISH;))
)
</BODY>
<TRAILER>
AP-NY-10-17-98 0550EDT
</TRAILER>
</DOC>