Corpus Introduction-Chap 1
Corpus Introduction-Chap 1
1.3 Terminology
In this section, some key terms that will be used throughout the book
are explained. They are: text, type, token, lemma, wordform, ngram,
concgram, tag, parse, annotate and metadata.
In one sense, there are 84 words in this paragraph. That is, there are
84 sequences of letters separated by spaces or punctuation. The word
token is used to mean ‘word’ in this sense: the paragraph consists of 84
tokens. It is also said that the paragraph consists of 84 ‘running
words’. However, many of these words occur more than once: a,
narrative, units and which occur three times each; stylistics occurs
two times; to occurs six times and so on. If each unique word is
counted only once, there are 60 words, or 60 types, in the paragraph.
As texts get longer, more words tend to be repeated, so the number of
types relative to the number of tokens goes down. Texts that are
carefully written and contain complex ideas, such as the one above,
tend to have more types relative to the number of tokens; texts that are
easier to read have fewer types relative to tokens. The type-token ratio
(TTR) is often used to compare texts. Corpora are often described in
terms of their total number of tokens and types, and the average
number of tokens and/or types per text.
1 M. ertwined with neutrinos. We’re very excited about the possible connection, says Nelson. This is the only theory of dark
2 N. season, Borys says, has been stretched. That’s partly possible, exhibitors and analysts say, because moviegoing has
3 N. fine? Email us at ADDRESS with your tale for possible inclusion in an upcoming USA TODAY story.
4 N.and services would be allocated to the greatest extent possible, but this was a way for the State to avoid giving special
5 N. discos, indeed anything to attract the largest crowd possible into their already overcrowded establishments. And all in
6 B.ng more than one sentence. Each item has more than one possible answer. Example: My dog barks, and I have to move out of my
7 N. These developments raise questions related to other possible routes of transmission of SARS. These may involve
8 N. gues in Europe and there is also the added benefit of possible post-career opportunities. Heavy has seen his crock
9 N. as three bedrooms, two upstairs. But somehow it seems possible to stuff quite a few people into it, more than three bedroom
10 N.ss san Jose Calif. It might have seemed to be the best possible week for boosters of the Linux open-source operating
11 B.cline of the Public Sphere. There is, however, a final possible explanation for the decline of social equality – the Civic
12 B.and looked at her carefully. Did I? You did everything possible, Morgan. I could see Andy just a few feet away.
13 B.of a sandy wash, and he had wanted to sleep as long as possible. Looking at the agitated old man, Wanda wondered if perhaps
14 B. it could again either halve or rise 1.5 times, giving possible interest rates of 2, 6, or 18 percent. Now look at the pric
15 B.everyone working for minimum rates, it would hardly be possible to make it for so little, and in fact the film actually came
16 N.d. Board members are expected to continue discussing a possible 2004 construction bond measure. Electric blanket may have
17 B.w that he could resolve everything in the simplest way possible. He mustn’t let himself sink into total oblivion so that he
18 S. his call for the union treaty to be signed as soon as possible, to be followed as planned by elections for a new federal
19 N. families (although their presence in the opener makes possible a finale, in which Aggie compels her to hug her equally
20 N. sidiary of Motibhai’s, with the best level of service possible to support the effectiveness and success of their duty free
21 B. made a pass at him a long time ago, but in the nicest possible way he said I wasn’t his type. You’re a lucky girl. The only
22 S.the president, Mr Gbagbo. So that means it will not be possible to engage any kind of disarmament process without voting
23 N. planning going on yesterday was focusing on the worst possible scenario. In the lead-up to the outbreak of a war, the
24 S. about nervous reaction from financial markets to a possible Lula victory, the former labor leader said markets are
25 B.Until then we travelled to the races together whenever possible. Not any more. It wasn’t possible once we were at each other
Table 1.2 Patterns of possible in 250 random lines from Wordbanks Online
Pattern Examples
possible + noun . . .a possible merger. . .
. . .a possible leak or fire. . .
. . .a possible evacuation of 1,000 Canadians in the
. . .face possible deportation
. . .looking for possible connections
. . .the extent of possible brain damage. . .
One possible avenue. . .
. . .the possible resumption of diplomatic ties. . .
two of the possible intermediaries. . .
link verb + possible Anything’s possible.
. . .to come back if it’s possible
. . .that love is possible for all of us
I still think pressure is possible
A deal for devolution is still possible. . .
Was such a thing possible?
it + be + possible + to It’s possible to provide information to the public
it will not be possible to engage any kind of disarmament pro
It is possible to support the battle against terror
. . .it is possible to rid yourself of any fear. . .
It must be possible for people to have access to the air
. . .why it wasn’t possible to think of nothing at all
It was possible to see clearly what war had wrought
(continued)
13
https://doi.org/10.1017/9781108616218.001 Published online by Cambridge University Press
16