# Posterior predictive distributions for text stimuli in the experiment

$$
\newcommand{\Prob}[1]{\mathrm{P}( #1 )}
\newcommand{\given}{\vert}
\newcommand{\text}{\mathrm{text}}
\newcommand{\xtext}{w_1, w_2 \ldots w_n}
$$

The following calculates the posterior prediction over words conditioned a text.

Given a text $\text$, the posterior predictive distribution is, informally speaking, the distribution over words that are consistent with the discourse topics of the $\text$. It is calculated as follows:
$$
\begin{align}
\mathrm{P}(w \given \phi, \text, a, m) &= \int \mathrm{P}(w \given \phi, \pi) \mathrm{P}(\pi \given \text, \phi, a, m) d\pi,\\
&= \int \big[ \sum_{\{x\}} \mathrm{P}(w \given \phi, x)\mathrm{P}(x \given \pi) \big] \mathrm{P}(\pi \given \text, \phi, a, m) d\pi
\end{align}
$$
where $\mathrm{P}(\pi \given \text, \phi, a, m)$ is the posterior distribution over topic distributions of text $\text$, with $\phi$, $a$, $m$ being the parameters of Topic model ($\phi$ is the set of $K$ component topics and $a$, $m$ are the hyper-parameters of the Dirichlet prior over the per document mixing distribution).

Note that we need to infer the posterior $\Prob{\pi \given \text, \phi, a, m}$ by sampling using a Gibbs sampler. Specifically, we iteratively sample as follows:
$$
\begin{aligned}
x_{1:n} &\sim \Prob{x_{1:n} \given w_{1:n}, \phi, \pi},\\
\pi &\sim \Prob{\pi \given x_{1:n}, a, m}.
\end{aligned}
$$
The probability distributions in both of these steps can be calculated exactly.

## Preface
The simulations here require the use of the ipcluster, e.g. `ipcluster start -n 16`, and will take about 12 hours on a 16 core processor. The simuluations have been started with known random seeds, and so all the results will always be identical. If you set `use_cached_result` to `True` on the two instances below, the simulation results will be loaded from the cache and the simulations will not be re-run. Using this, you can get the print-out of the main results without taking any real time, i.e. in around 30 seconds.

```python
from __future__ import division
import numpy
import os
import re
import configobj
import datetime
import cPickle as pickle
from itertools import cycle

import pandas

from gustav import models

from utils import topicmodels, utils, datautils
```

## Check required files

* In this notebook, we do the posterior predictions based on the Topic model 2290, which has 1500 topics. We use the Gibbs sampler iterations 19000 to 20000, thinning to every 10 steps. The relevant files are stored in the `cache_directory` and the filenames are in `hdptm_samples.cfg`.
* We will also need the `Brismo.cfg` file, which are the settings for the online *Brisbane* experiment and so contain all the texts that were used in that experiment.
* We also need the BNC corpus that was used to train Topic model 2290. This is `bnc_texts_78639361_183975_251_499.npz`.

```python
cache_directory = 'cache'
cache_fullpath = lambda path: os.path.join(cache_directory, path)

filenames = {
    'experiment_cfg' : [('Brismo.cfg',
                         '909d9f8de483c4547f26fb4c34b91e12908ab5c144e065dc0fe6c1504b1f22c9')],
    'corpus' : [('bnc_texts_78639361_183975_251_499.npz',
                 '976d2ba53ecbacd092df21c4c04adf47d033fec3901e884cce69ca66ec280831')],
    'samples' : configobj.ConfigObj('hdptm_samples.cfg')\
                ['hdptm_201117172636_2290_state_checksums'].items()
}

utils.verify_cache_files(filenames['experiment_cfg'] +\
                         filenames['corpus'] +\
                         filenames['samples'],
                         cache_directory,
                         verbose=False)
```

Load up the corpus used by the topic models.

```python
corpus_data = numpy.load(cache_fullpath(filenames['corpus'][0][0]))
data = models.BagOfWords(**corpus_data)
```

Confirm which iterations of the Gibbs sampler for model 2290 we are using.

```python
sample_indices = [int(x.split('_')[-1].strip('.npz')) for x, y in filenames['samples']]
```

Average over all the posterior samples from iteration {{min(sample_indices)}} to iteration {{max(sample_indices)}}, thinning to every 10th one. If the cached result is not used, then this will take around 10-15 mins.

```python
use_cached_result = True
cached_posterior_average_fname = 'hdptm_201117172636_2290_posterior_average.pkl'

if use_cached_result:

    cached_posterior_average = utils.load_pkl(cache_fullpath(cached_posterior_average_fname))
    Phi = cached_posterior_average['Phi']
    am = cached_posterior_average['am']

else:

    Phi = None
    am = None
    for samples_item in filenames['samples']:

        sample_filename, _ = samples_item

        state = numpy.load(cache_fullpath(sample_filename))
        model = models.HierarchicalDirichletProcessTopicModel.restart(data, state, None, None)
        model.get_counts()
        phi = model.S + model.psi*model.b
        phi = (phi.T/phi.sum(1)).T

        if Phi is None:
            Phi = phi
        else:
            Phi += phi

        if am is None:
            am = model.a * model.m
        else:
            am += model.a * model.m

    n = len(filenames['samples'])

    Phi /= n
    am /= n

    assert numpy.allclose(Phi.sum(1), 1.0)
    utils.save_pkl(cache_fullpath(cached_posterior_average_fname), Phi = Phi, am = am)

assert utils.checksum(cache_fullpath(cached_posterior_average_fname))\
       == '0dc86b2ef9f2f53cd38925c7244612470ee16c703d4151943ecb341682c76580'
```

# Review inferred topics

Look at some of the inferred topics.

```python
seed = 101
K, _ = Phi.shape
print('\n'.join([models.showtopic(Phi[k], data.vocabulary, show_probability=False, K=10)
                 for k in numpy.random.RandomState(seed).permutation(K)[:50]])
     )
```

    centre, centres, shopping, staff, community, local, facilities, run, activities, time
    nature, time, flea, natural, idea, fleas, mutilation, delicate, human, passion
    terms, contract, conditions, standard, parties, contracts, buyer, seller, party, business
    book, published, books, guide, author, history, written, volume, edition, information
    pockets, tent, bag, nylon, fabric, jacket, bags, fleece, zip, comfortable
    killed, government, police, security, people, army, attack, attacks, claimed, forces
    age, life, ageing, ages, time, people, youth, late, women, average
    bath, water, bathroom, shower, hot, toilet, taps, cold, towel, soap
    player, hamlet, pause, king, coin, heads, tragedians, time, upstage, dead
    nuclear, power, reactor, fuel, plant, reactors, station, plutonium, energy, stations
    mason, pageant, angel, boy, play, god, stage, wagon, father, time
    carrier, bill, bills, carriers, cargo, carriage, delivery, party, freight, ocean
    design, architecture, architect, architects, building, buildings, architectural, style, office, designs
    party, labour, national, conference, communist, policy, left, movement, government, parties
    animals, animal, welfare, human, wild, cruelty, species, zoo, suffering, monkeys
    crisis, crises, system, penal, account, legitimacy, collapse, time, riots, conditions
    robin, hood, time, people, day, collage, personal, bit, bump, sheriff
    screening, genetic, congenital, handicap, mental, abnormalities, risk, syndrome, affected, gene
    chemical, chemicals, products, industry, plant, business, company, production, materials, process
    paper, white, government, proposals, policy, published, green, report, review, public
    fishing, community, vessel, vessels, nationality, article, law, court, commission, treaty
    records, record, diary, diaries, recorded, registers, register, recording, date, entry
    eyes, body, mouth, lips, arms, hand, hands, head, fingers, hair
    cat, cats, animal, pet, kitten, feline, kittens, dog, owners, human
    philosophy, knowledge, ideas, nature, idea, experience, mind, natural, philosophical, real
    activity, activities, time, level, practice, active, person, range, involved, engage
    squadron, air, war, flying, bomber, aircraft, time, command, force, crew
    memory, arousal, driving, studies, performance, task, situations, recall, subjects, memories
    snow, cold, ice, winter, frozen, wind, freezing, day, warm, weather
    engineering, engineer, engineers, design, engine, steam, mechanical, machine, engines, electrical
    history, historical, historians, evidence, sources, past, historian, material, documents, study
    dot, dear, time, baby, loopy, people, nice, brown, till, pet
    animals, wild, animal, tiger, hunting, prey, lion, food, lions, goat
    cake, icing, cakes, marzipan, chocolate, cut, paper, top, dry, royal
    riven, bicker, hills, gnomes, eyes, giants, people, horses, time, sword
    dark, elves, world, elf, magic, chaos, power, phoenix, king, ancient
    costs, cost, incurred, basis, expenses, benefit, benefits, charges, amount, taxation
    door, stairs, house, window, front, kitchen, heard, floor, inside, stood
    bike, walk, walking, cycling, route, ride, cycle, miles, mountain, cyclists
    smell, scent, smells, odour, perfume, air, nose, sense, scents, sweet
    billy, bit, real, cos, sort, pretty, round, summat, people, nice
    people, government, lineage, image, peace, tribe, lineages, shaikhs, shaikh, time
    police, body, found, murder, inspector, death, dead, missing, detective, sergeant
    tribunal, tribunals, representation, appeal, procedure, adjudication, decision, industrial, hearing, parties
    crime, criminal, criminology, deviance, classical, positivist, social, behaviour, theories, criminals
    books, book, publishers, publishing, titles, booksellers, sales, publisher, trade, author
    spirit, dodge, air, time, spirits, mull, isle, waters, universal, party
    purchaser, vendor, sale, business, information, agreement, completion, mas, letter, acquisition
    cent, inflation, recession, rates, economy, growth, rate, economic, recovery, rise
    glass, window, windows, mirror, doors, double, glazing, mirrors, stained, door

```python
use_cached_result = True
mcmc_sampler_seed = 20202
cached_sampler_result = 'posterior_predictions.2290.%d.pkl' % mcmc_sampler_seed
texts = topicmodels.get_experiment_texts('Brismo.cfg', cache=cache_directory)

def get_failed_to_converge(posterior_predictions, threshold=1.01):
    converged = []
    failed_to_converge = []
    for x,y in posterior_predictions:
        if numpy.round(y[1], 2) > threshold:
            failed_to_converge.append(x)
        else:
            converged.append(x)

    # If we use the same datasets on different cluster
    # engines, we may have a given dataset converging
    # on one engine and not another. In that case, we want to
    # exclude that dataset from the 'failed_to_converge'
    # dataset.
    return list(set(failed_to_converge).difference(converged))

def get_arguments(failed_to_converge):
    arguments = []
    for name in cycle(failed_to_converge):
        arguments.append((name, random.randint(101, 1001)))
        if len(arguments) >= len(clients):
            break
    return arguments

if not use_cached_result:

    from ipyparallel import Client

    model = topicmodels.PosteriorPredictive2(corpus_data, Phi, am)
    clients = Client()

    clients.block = True

    clients[:].push(dict(
        model=model,
        texts=texts)
    );

    view = clients.load_balanced_view()

    random = numpy.random.RandomState(mcmc_sampler_seed)
    arguments = zip(texts.keys(),
                    random.randint(1001, 10001, size=len(texts.keys())))

    func = lambda argument : (argument[0],
                              model.posterior_prediction(texts[argument[0]],
                                                         seed=argument[1],
                                                         burn_in_iterations=100000,
                                                         iterations=50000,
                                                         max_attempts_to_converge=15))

    _posterior_predictions = view.map(func, arguments)

    posterior_predictions = {}
    for x, y in _posterior_predictions:
        posterior_predictions[x] = y[0]

    ###################################
    # Try again with the slow learners
    retry = 0
    while True:

        failed_to_converge = get_failed_to_converge(_posterior_predictions)

        if len(failed_to_converge) > 0:

            retry += 1
            print('Retry %d: Number of failures = %d' % (retry,
                                                         len(failed_to_converge)))
            print('Failures: %s' % ','.join(failed_to_converge))

            arguments_retry = get_arguments(failed_to_converge)

            _posterior_predictions = view.map(func, arguments_retry)

            for x, y in _posterior_predictions:
                posterior_predictions[x] = y[0]

        else:

            break

    timestamp = datetime.datetime.now().strftime('%Y.%m.%d.%s')

    with open(cache_fullpath(cached_sampler_result), 'wb') as f:
        pickle.dump(posterior_predictions, f, protocol=2)

else:

    with open(cache_fullpath(cached_sampler_result), 'rb') as f:
        posterior_predictions = pickle.load(f)

assert utils.checksum(cache_fullpath(cached_sampler_result))\
   == 'e0941816a08af95379a291af9df93885fcae613e068cc6f6e051e39b78cf2742'
```

```python
for text_name in sorted(posterior_predictions.keys(), key=lambda args: int(args.split('_')[1])):
    print(text_name)
    print('-'*len(text_name))
    print(texts[text_name])
    print('='*10)
    print(topicmodels.topic2str(posterior_predictions[text_name], corpus_data['vocabulary'], K=100))
    print('='*50)
    print('')
```

    text_0
    ------
    ‘I don't know what I did without it’ is the sentiment. There is a difference
    between fully automatic washing machines — which change the nature of the task
    altogether — and ‘twin tub’ machines where the hot wet washing has to be
    lifted manually into a separate drying compartment. The women who had this type
    of machine complained about the considerable amount of work still required of
    the housewife, and the mess on the kitchen floor to be cleared up afterwards. In
    a similar way the launderette does not remove the physical drudgery of washing.
    The housewife has to get the washing there in the first place, she has to unload
    it, sort it, sit and watch it wash and dry (or dash out to shop in the interim)
    and then pack it all up again. This, when there is a baby in the pram and a two-
    or three-year-old to attend to, is no mean feat.
    ==========
    housework,housewife,water,washing,clean,women,time,clothes,job,wash,day,kitchen,housewives,cleaning,shop,wife,floor,satisfaction,dirty,baby,house,home,vehicles,built,carriage,bed,hot,mother,washed,standards,fitted,bath,dry,bathroom,children,role,machine,wheels,table,social,sink,body,husband,people,coach,ironing,hands,dissatisfaction,mind,train,forty,vehicle,cold,feel,dissatisfied,door,cooking,towel,domestic,hair,trailer,wet,soap,satisfied,tasks,coaches,compartment,hand,woman,iron,steel,left,laundry,feet,sheets,covered,sample,carried,finished,routines,jobs,question,child,wheel,system,roof,trains,days,brake,change,night,morning,dust,warm,saloon,tidy,bogies,factory,special,railway
    ==================================================

    text_1
    ------
    Don Juan today has lost whatever sympathetic press the years of male domination
    gave him. Feminism and a greater acknowledged (though not necessarily practised)
    awareness of the equality and independence of sexual rights have becalmed the
    Don as a fool of time. Psychology has dissected him to death. AIDS has ousted
    him out of history. But there is little point, for instance, in turning on an
    artistic, enlightened medieval king because he also enjoyed slaughtering
    hundreds of deer in a day's hunt and daubing the fresh blood on his own face and
    those of his friends. Examples can be multiplied. To yank someone entirely out
    of their time and smack them around for not being of our time is perhaps a
    salutary but only a limited exercise. Yet the times have indeed changed: and
    Burton's early sexual insatiability, his later infidelities, his many women and
    his concurrent devotion to monogamy all need some explaining.
    ==========
    women,male,century,woman,female,time,sexual,feminist,sex,life,hunt,bra,hunting,king,nineteenth,world,fox,people,day,underwear,power,gender,society,love,feminism,bras,feminists,rights,deer,found,country,late,body,social,feel,role,left,change,history,times,centuries,position,family,modern,eighteenth,political,twentieth,death,view,period,hounds,public,movement,sexuality,feminine,middle,half,lace,mind,mother,sense,hand,foxes,told,past,experience,strong,nature,control,home,days,image,changed,natural,question,equal,father,simply,book,shooting,don,human,common,brought,land,issues,briefs,class,terms,real,short,lives,stretch,means,form,straps,field,true,set,lost
    ==================================================

    text_2
    ------
    When John Major talks of a ‘nation being at ease with itself’, which
    particular nation is he speaking about? Is he addressing his comments to all
    those who have become marginalised and dispossessed as a result of right-wing
    Conservative policies over the years? Or is he speaking about that nation of
    complacent and indifferent shopkeepers who long for nothing other than a return
    to the days of imperial hegemony? The shopkeeper as the centre around which the
    social world revolves is a commercial image hammered into English consciousness
    by Mrs Thatcher. Self reliance, individual enterprise, ‘what's in it for
    me’, as opposed to‘how can we help our neighbour’, was the message. This
    theology slipped over the iron hand of the capitalist market like a silk glove.
    England became one nation again, a land of hope and glory, Elgar, teacakes and
    cricket. This England is not one recognised by many of my friends.
    ==========
    government,people,party,labour,world,conservative,political,speech,shop,god,policy,social,time,power,national,policies,economic,country,left,thatcher,conservatives,voice,life,public,human,liberal,election,support,nation,politics,change,words,cricket,war,reform,shops,society,john,trade,speak,free,test,day,future,history,live,radical,christian,sense,language,parties,store,tony,socialism,hand,market,land,lives,west,major,home,hope,business,programme,poor,economy,socialist,governments,popular,means,past,welfare,liberals,speaking,lord,called,stores,real,system,match,community,century,opposition,view,ideas,leaders,form,politicians,nations,unions,unemployment,class,leader,local,word,office,nationalism,living,shopping,freedom
    ==================================================

    text_3
    ------
    The form of animal husbandry adopted depends on the type of facilities available
    and the nature of the experiments. If an experiment produces animals that are to
    be kept for a long period, or that are to form the basis of a breeding colony,
    some form of barrier system is essential. If no precautions are taken to prevent
    infections it is inevitable that the health of the animals will deteriorate with
    a resulting decrease in breeding performance or death. A minimal barrier system
    requires people entering the animal area to remove their laboratory coats worn
    in other areas, and to put on protective  clothing. It is essential that they
    wash their hands thoroughly before handling the animals and the wearing of
    surgical gloves and a change of footwear or overshoes should be considered. A
    more stringent barrier includes the requirement for staff to shower on entering
    the unit and a complete change of clothes.
    ==========
    mice,animals,rats,system,rat,form,animal,equipment,mouse,forms,time,mutant,change,water,systems,clean,maintenance,control,cage,safety,health,building,required,human,welfare,clothes,breeding,people,fire,facilities,washing,cages,storage,ensure,shown,wash,floor,rodents,rearrangement,days,cleaning,house,kitchen,provided,protection,provide,wild,poison,means,strain,installed,access,found,free,species,plant,carried,operation,bred,installation,buildings,cruelty,supply,care,requirements,litter,tail,including,staff,hot,essential,similar,main,natural,standard,vermin,dirty,bed,set,day,construction,designed,zoo,dogs,design,injection,level,sterile,result,bath,dry,infection,risk,bathroom,rodent,conditions,allowed,life,skin,suffering
    ==================================================

    text_4
    ------
    I then took her forward slightly to the evening after the operation, a time when
    she was fully awake and over the more drastic effects of the anaesthetic. I
    asked her how she felt now. To my surprise Kirsty burst into tears. No, she told
    me, she was not in any great pain — simply the discomfort she would have
    expected to follow surgery. She was not aware of feeling particularly ill. It
    was just that she knew that there was something seriously wrong with her —
    something far more dramatic than a grumbling appendix or the normal after-
    effects of an operation. Oh, the doctors and nurses had assured her again and
    again that she was fine and would soon be fit and well again. And yet, as she
    kept repeating, she was convinced that there was something that no one was
    telling her.
    ==========
    hospital,doctor,effect,effects,time,home,told,ill,day,days,life,doctors,died,pain,months,illness,heart,weeks,condition,cancer,treatment,family,bed,left,husband,night,wife,medical,patient,sick,suffered,nurse,health,found,mother,operation,suffering,hours,death,feel,week,people,children,die,ago,disease,eyes,looked,brain,result,started,visit,impact,live,morning,care,affect,direct,clinic,woman,attack,surgery,feeling,bad,wrong,son,patients,called,recovery,suffer,rest,diagnosed,daughter,stay,treated,ward,ambulance,father,affected,heard,admitted,blood,suddenly,chest,unable,difficult,friends,tests,worried,severe,finally,lost,happened,drugs,friend,month,dying,stomach,short,taking
    ==================================================

    text_5
    ------
    It was mentioned above that overflow records arise singly. In addition, an
    embedded overflow area will usually contain varying numbers of records from
    several tracks. This leads to overflow records usually being stored in unblocked
    format, even if the records in the prime data area are blocked. There is some
    advantage in treating the whole embedded overflow area as a single large blocked
    record, and manufacturers' software often does transfer the whole track into
    main storage when an addition is to be made; this allows for the addition
    itself, creation of link fields, changes of index, etc. However, handling the
    whole track as a single block would prevent rapid transfer of individual records
    from the embedded overflow area during direct access reference, which is the
    reason this method is often not adopted (but see the section on software
    packages, p. 264).
    ==========
    file,records,record,files,index,track,storage,overflow,data,time,access,key,search,stored,address,sequential,additions,required,synonyms,space,direct,processing,cylinder,size,shown,keys,home,bucket,random,average,packing,times,method,indexed,retrieval,addresses,inverted,buckets,indexes,set,added,sequence,table,held,cent,prime,synonym,loaded,device,algorithm,software,technique,main,position,accesses,process,discussed,processed,hold,single,density,start,positions,directly,serial,disk,require,chapter,located,separate,designer,run,allocated,accessed,store,reference,found,due,expected,half,head,information,user,revolution,results,provide,result,figure,pointers,frequently,searching,performance,sequentially,field,handling,read,series,system,tracks,load
    ==================================================

    text_6
    ------
    Though innovation is a very positive term, it is important to remember that any
    particular innovation is only positive in retrospect, after it has worked. Before
    that, because change by definition is something no one has seen yet (despite
    models that may exist elsewhere), it has to be taken at least partially on
    faith. For example, why a continuing education program now? Why use funds to
    develop a new product when there are so many already on the market? Why take the
    risk of decentralizing the accounting office? In short, unless there is somebody
    behind the idea willing to take the risk of speaking up for it, the idea will
    evaporate and disappear. One reason there is so little change in most
    traditional bureaucratic organizations, I argue, is that they have conditioned
    out of people the willingness to stand up for a new idea. Instead, people learn
    to back off at the first sign that somebody might disapprove.
    ==========
    positive,negative,innovation,people,ideas,creative,creativity,thinking,time,organization,process,technology,innovations,idea,development,product,change,market,innovative,success,successful,organizations,invention,opportunities,organizational,technological,individuals,person,research,critical,effective,company,individual,difficult,industry,lead,knowledge,management,technical,approach,result,risk,education,found,opportunity,products,ability,concept,solutions,means,original,business,highly,essential,resources,project,feel,world,tend,changing,model,solving,form,requires,potential,climate,environment,responsibility,hand,inventions,processes,companies,imagination,focus,imaginative,control,makes,office,entrepreneurs,obvious,activity,developed,solution,difference,economic,positively,managers,entrepreneurial,innovators,talk,money,false,originality,quality,true,system,real,information,involves,practice
    ==================================================

    text_7
    ------
    Some social scientists have conceptualised these workers in terms of a reserve
    army of labour. In this case, they would constitute a pool of labour which can
    be utilised in boom periods and disregarded in recessions. This view sees the
    experience of the Third world as being little different from that of the
    industrialised countries. The large numbers who are unable to find regular
    work are not seen as a phenomenon characteristic of underdevelopment, but part
    of the capitalist division of labour and, therefore, a similar feature to the
    industrialisation process of European countries, differing in terms of quantity
    rather than quality. For Marx, however, the function of the reserve army of
    labour was keeping wages low and, to this end, the absolute size of the reserve
    army need not be very great. The high numbers and continuing growth of this
    sector in Latin America would suggest that concepts of European analysis are not
    sufficient.
    ==========
    countries,world,defence,military,workers,labour,forces,economic,theory,growth,army,development,force,international,wages,armed,economy,time,employment,trade,terms,global,developing,differences,analysis,rate,social,period,country,approach,wage,system,national,level,investment,increase,structure,theories,cent,troops,market,capital,aid,women,developed,united,air,industrial,production,view,nations,productivity,war,increased,service,prices,political,demand,employers,real,nature,output,major,governments,based,staff,ministry,rates,theoretical,low,common,western,worker,government,similar,account,pattern,form,industry,skilled,rise,inflation,paid,resources,features,role,chapter,employed,process,poor,conditions,concept,jobs,policy,study,extent,individual,provide,navy,basic
    ==================================================

    text_8
    ------
    In the case of time constant, a production worker tends to be focused on the
    production schedule for today or this week. An R&D worker is aware that what he
    does today will not affect company output in this order of time span. It may be
    months or years before his work today makes an impact: in the case of a project
    failure it may never do so. Words such as ‘hurriedly’ and ‘quickly’ are
    likely to be associated with different orders of time spans in the minds of the
    two people. Salesmen are probably in between these two. They have in some cases
    a weekly or monthly schedule of orders to win but the long-term relationship
    with their customer is also of great importance and the weight to be put on the
    two factors at any one time calls for the exercise of judgement.
    ==========
    months,time,production,week,period,weeks,product,month,people,process,company,manufacturing,days,control,products,day,august,quality,design,start,technology,short,produced,factors,stage,management,final,plant,twelve,cost,life,involved,sales,social,set,times,person,workers,costs,materials,factory,organisation,experience,feel,individual,decision,produce,project,summer,machine,half,line,eighteen,required,department,progress,completed,date,difficult,assembly,spent,carried,started,labour,ten,system,manufacture,total,finished,job,beginning,received,task,found,change,care,stock,result,continued,initial,tasks,processes,previous,complex,relationship,march,regular,planning,decided,decisions,earlier,levels,support,main,activities,purchasing,operation,machines,development,home
    ==================================================

    text_9
    ------
    In the afternoon, we have a rehearsal, but without the guests. I just walk
    through the basic moves so the cameras can plot where everybody's going to be,
    and we try to work out how long people will take to walk down the stairs so we
    can play the right amount of music. If they can make it, we like the guests to
    arrive before the audience starts to go in, so they can walk through it, too.
    Those steps  down to the set can be daunting — I think it's everybody's
    nightmare, stepping out and falling flat on your face. Dusty Springfield was
    wearing new shoes, with very high heels, and was terrified that she'd slip, so
    just before she was due to go on, one of the team was dispatched to look for
    some scissors to scratch the soles with. Oh, the glamour of it all.
    ==========
    shoes,shoe,time,foot,pair,film,door,feet,house,boots,leather,doctor,people,set,series,heel,socks,story,star,front,wear,day,fit,night,script,footwear,movie,left,play,director,television,home,production,floor,life,verity,cast,john,top,inside,air,world,street,found,audience,actor,episode,called,sock,played,party,sole,garden,cushioning,lot,drama,evening,round,idea,hotel,team,pairs,road,looked,shop,running,boot,theatre,stage,role,size,soles,feel,walk,light,heavy,wearing,slippers,rubber,days,worn,window,toes,wall,start,walking,dinner,love,hand,children,studio,producer,head,trainers,stars,characters,stone,screen,shoemaker,stood
    ==================================================

    text_10
    -------
    My understanding of the law is that an adult patient who is capable of doing so
    must give consent to any medical treatment if that treatment is to be lawful. At
    the time of the decision the patient needs a capacity commensurate with the
    gravity of that decision. If the patient lacks the requisite capacity, then the
    doctors must act in what they perceive to be his or her best interests, with
    information garnered from previous knowledge of the patient, discussion with
    family and friends, and taking into account any relevant directive previously
    made by the patient. What the legal force and effect of any such directive might
    be is uncertain; it is unclear whether health care staff are required to carry
    out the terms of the directive or whether those who act in good faith with the
    terms of the directive are immune from civil or criminal prosecution. There is,
    apparently, no case law on this point.
    ==========
    patient,consent,treatment,law,doctor,medical,legal,decision,doctors,refusal,minor,act,health,person,circumstances,court,community,life,commission,wishes,age,directive,time,duty,situation,section,patients,understanding,authority,information,principle,hospital,request,mental,treat,legislation,refuse,blood,knowledge,care,parents,child,condition,informed,common,question,matter,view,proposed,effect,adult,judgment,euthanasia,die,ill,effective,national,laws,death,accept,issue,criminal,position,competent,form,doubt,transfusion,concerned,risk,terms,guardian,parent,free,ventilator,capacity,mind,required,involved,respect,decisions,refusing,sufficient,measures,continue,pain,terminally,decide,inherent,difficult,market,considered,clinical,courts,giving,council,article,operation,power,jurisdiction,apply
    ==================================================

    text_11
    -------
    The bones are bound to each other by tough, flexible ligaments and are
    articulated at the joints by muscles. There are just over 600 voluntary muscles
    in the human body. For our purposes, it is only necessary to mention the larger,
    superficial muscle groups which affect the shape of the body and are responsible
    for the movement of the limbs. These are referred to as skeletal muscles, most
    of which are attached at both ends to bones. The muscles that give expression to
    the face are also referred to as skeletal muscles, and they link bone to skin. A
    whole complex system of muscles is brought into play for each movement of the
    body: bending an arm involves the shortening of the biceps, while the tricep
    muscles at the back of the arm must relax and lengthen in unison. Meanwhile,
    others immobilise joints not needed in the action, while others still adjust to
    stabilize the body's equilibrium.
    ==========
    body,bodies,leg,legs,head,arms,human,left,feet,arm,hands,time,foot,position,front,muscles,hand,bodily,pain,straight,shoulder,knees,forward,weight,knee,governing,shoulders,lower,movement,floor,stand,mass,bend,move,subject,hold,exercise,slowly,toes,means,figure,upper,chest,drawing,injury,system,bones,bent,ground,normal,pull,rest,slightly,inside,broken,upright,exercises,elbow,keeping,injuries,neck,hips,height,raise,wound,movements,relation,organs,standing,spine,physical,draw,length,forwards,perfectly,lift,ankle,start,backwards,hard,complex,balance,waist,basic,hip,skin,close,account,flat,muscle,machine,past,sit,holding,organ,understand,functions,main,direction,repeat
    ==================================================

    text_12
    -------
    The extent to which subject coverage on the shelves can be achieved is a matter
    of library policy, funding, the amount of shelf space available, and the
    efficiency of interlending systems to which the authority has recourse. These
    influences are considered in more detail in Chapter 12. The case for immediate
    shelf representation in a public library is made at some length by Ranganathan,
    in his fourth library law —‘save the time of the reader’. ‘Mental hunger
    for books is not compelling in the case of most people. Mental thirst for
    information is not inexorable in the case of most people. Both of them are
    fleeting in their nature. They both die out, unless satisfied immediately on
    their taking shape. No time lag should come between demand and supply. The tempo
    for reading is often momentary. It should be harnessed at the very moment.’
    ==========
    library,libraries,books,time,people,book,public,stock,subject,information,collection,librarian,librarians,world,collections,material,service,chapter,desire,reference,staff,law,materials,services,pleasure,selection,research,factors,catalogue,life,university,user,experience,titles,literature,provision,mind,sense,users,physical,national,mental,access,publications,main,special,reading,items,knowledge,form,individual,system,found,consciousness,readers,death,academic,catalogues,shelves,periodicals,resources,real,recent,range,bibliography,terms,section,policy,volumes,human,lending,nature,desires,survey,difficult,major,published,revision,instance,journals,matter,copies,music,subjects,view,demand,date,set,space,factor,records,sources,printed,loan,include,common,past,level,spent,simply
    ==================================================

    text_13
    -------
    In Ordinary Justice the National Consumer Council were scathingly critical of
    such court proceedings which in practice, they said, became a rubber stamp. The
    documents the court sent out were difficult to understand and no guidance was
    given on completing it. The ‘defendant’ was not asked about his personal
    circumstances. The Civil Justice Review found that a third of banks and building
    societies, and a fifth of local authorities, did not enquire about the debtor's
    circumstances before the hearing. Three quarters of local authorities did not
    follow up the Department of Environment's advice and carry out checks to see if
    the tenant was receiving the right benefits. Sixty-seven per cent of creditors
    had no knowledge of the debtor's financial state at the time of the original
    transaction, and 77 per cent did not obtain any further information before or
    during the proceedings.
    ==========
    court,local,advice,appeal,mortgage,information,authority,cent,bank,authorities,husband,wife,service,house,judgment,judge,services,housing,charge,creditor,time,bureau,building,decision,security,home,law,government,plaintiff,proceedings,action,national,defendant,people,influence,council,act,application,rate,cab,loan,property,contact,notice,debtor,societies,office,rates,undue,society,legal,party,support,evidence,surety,offer,bureaux,provide,plaintiffs,defendants,documents,effect,agency,held,question,circumstances,form,social,department,free,telephone,issue,central,agent,lenders,independent,details,set,matter,transaction,county,courts,person,hearing,loans,lord,claim,justice,special,association,document,found,mortgages,workers,jurisdiction,leave,public,grant,pay,required
    ==================================================

    text_14
    -------
    The Dickens study tells us that not every dismissed employee eligible to claim
    unfair dismissal does so. Only about one in ten of those eligible to claim
    actually does so. Among those who apply there is a greater tendency to bring
    unfair dismissal proceedings where the employer is a small single establishment
    employer with below average unionization. Nearly half of all applications are
    against employers with fewer than 20 employees. The larger the employer, the
    less likely it is that there will be an unfair dismissal claim. There are a
    number of possible explanations for this pattern of application. Larger
    employers are likely to have internal appeals procedures and failure there,
    where union representation may have been provided, is the point at which the
    employee draws the line. Employees may feel a sense of powerlessness in taking
    on a large organization or it may be that advisers are more reluctant to take on
    large organizations.
    ==========
    employer,employment,employee,tribunal,dismissal,employees,contract,industrial,cent,tribunals,job,union,unfair,employers,redundancy,trade,dismissed,unions,transfer,appeal,rights,company,claim,time,law,terms,organization,pay,table,business,representation,decision,employed,figures,procedure,notice,reason,legal,workers,statutory,relations,average,period,management,entitled,reasonable,fair,adjudication,internal,parties,hearing,figure,total,labour,circumstances,compensation,claims,position,security,act,protection,leave,court,external,rules,nature,regulations,evidence,system,bargaining,written,reasons,appeals,found,organizations,service,officer,payment,process,represented,apply,conditions,people,held,offer,procedures,social,question,relevant,conciliation,result,provide,courts,person,required,alternative,applicants,redundant,proportion,national
    ==================================================

    text_15
    -------
    Our terms of reference suggested that we should consider drama in the context of
    the great dramatic works of literature. We believe that plays should be
    approached through the dramatic medium; children should often see or participate
    in the play being acted, and not just read the text. This approach will not only
    result in an appreciation of the literary merits, but also foster an
    understanding of stagecraft. There is still an important place within drama
    activity for the exploration and study of scripted plays, and we addressed this
    aspect in our statements of attainment and programmes of study. At primary
    level, the range of material for exploration needs to be more diverse: myth,
    legend, fairy stories, poems. At secondary level, such work can expand naturally
    into the exploration of dramatic texts. Children's own writing can also be
    explored — at both levels — through the medium of drama.
    ==========
    children,drama,teacher,level,literature,curriculum,pupils,literary,story,levels,teachers,school,play,class,experience,role,education,child,schools,time,teaching,writing,criticism,texts,study,dramatic,cultural,stories,national,ideas,language,reading,critical,text,learning,activities,skills,subject,mathematics,studies,assessment,chapter,history,activity,range,subjects,book,attainment,read,primary,people,understanding,discussion,stage,theatre,mathematical,classroom,experiences,theory,renaissance,development,culture,poetry,secondary,academic,set,pupil,develop,modern,terms,materials,key,real,opportunities,simple,content,talk,create,opportunity,form,instance,writers,playing,sense,structure,difficult,science,critics,focus,told,educational,context,questions,historical,examples,short,vocabulary,life,approach,tradition
    ==================================================

    text_16
    -------
    Activity 1 (15–20 mins): Identify a small group of clients, such as the first six
    people you saw in your last day's community care, the first six people attending
    your outpatients' clinic, or six individuals in a bay in your ward. For each
    client, list the nursing interventions either by yourself or someone else, such
    as ‘insulin injection’, ‘mouth care’, ‘socialisation’, ‘health
    promotion’, that each required in the fist hour of care, say between eight and
    nine, or nine and 10 in the morning. You should end up with at least six
    separate lists, some with perhaps only one item on it, others with several
    items, listed in the order that each client received, or was assisted with, that
    care. Are there any items common to several, or all, of the clients? Did they
    receive similar care at the same time or in the same order?
    ==========
    list,nursing,client,nurses,care,patient,nurse,patients,ward,clients,time,lists,staff,health,names,hospital,clinical,people,items,day,firm,practice,individual,hours,ensure,include,minutes,medical,behaviour,social,lawyer,required,information,included,listed,lawyers,professional,team,visitors,item,personal,surgery,home,involved,individuals,person,period,community,assessment,unit,check,found,district,days,wards,ten,listing,hour,identify,night,admitted,morning,role,experience,advice,short,times,practitioner,operation,allocation,instructions,support,details,require,discuss,feel,carried,goals,set,senior,sister,treatment,preparation,service,surgical,write,return,responsibility,theatre,left,relationship,chosen,type,study,date,specific,chapter,addresses,provide,half
    ==================================================

    text_17
    -------
    Once again that requirement to get on with people, clients, account executives
    and the creative teams is basic to your daily work. Just how does cooperation
    between a planner and the creative team work? After all, creative people are
    supposed to be sensitive and aware of the consumer and society and in real touch
    with change and mood. Let's take an example of the planner and creative team
    together. Trying to devise the strategy for a lager campaign, the planner found
    out through the research that the key benefit consumers looked for in lager was
    refreshment — incidentally something no other beer advertiser mentioned. The
    creative team took this new insight and used it as a spring-board to create a
    very successful campaign based on sprouting leaves and the headline: "Refreshes
    the parts other beers cannot reach" , thus demonstrating the imaginative leap
    creative people make from research findings to effect communication messages.
    ==========
    advertising,team,agency,people,campaign,creative,product,agencies,advertisements,media,teams,marketing,ad,commercial,time,ads,innovation,research,brand,advertisement,ideas,account,television,market,client,products,sales,beer,advertisers,creativity,thinking,industry,clients,commercials,successful,promotion,posters,idea,job,press,brands,director,advertise,direct,process,business,magazines,sell,campaigns,buy,technology,approach,poster,set,department,companies,effective,message,run,consumer,audience,money,success,newspapers,company,development,major,innovations,image,magazine,consumers,adverts,medium,brewery,difficult,strategy,launch,task,selling,radio,change,newspaper,public,individual,budget,spend,means,innovative,create,produce,specialist,potential,target,designed,information,advert,brewers,real,copy,brewing
    ==================================================

    text_18
    -------
    While many of these may be social occasions, work groups especially in large
    companies may often stay on late to participate in quality control circles or
    zero defect clubs. There are up to four million quality control circle
    participants in Japanese industry and in large companies two in five workers are
    members. Quality consciousness is said to be very high among Japanese workers
    who endeavour to eliminate components that are rejected as substandard. Each
    smaller work group attempts to perform better than their rival groups in both
    quality control and in the number of suggestions they offer to improve
    productivity. Workplace harmony is enhanced by communal sports clubs, company
    vacation resorts, one-class cafeterias and the absence of status barriers within
    the plant. There is an hierarchical structure, but managerial authority is
    respected as a benign guardian of company interests. Corporate identification
    with workers knowing their place is in short "a managers Nirvana".
    ==========
    quality,control,management,company,organisation,workers,time,club,technology,process,life,jobs,people,business,companies,improvement,service,job,experience,system,team,production,staff,customer,organisations,performance,customers,sport,employees,world,human,manager,factory,managers,means,structure,training,standards,labour,plant,systems,industry,sports,programme,development,set,union,organization,individual,social,total,spiritual,responsibility,authority,relationship,improvements,form,sense,nature,machine,level,love,power,success,ski,controls,change,machines,market,procedures,relationships,god,assurance,temporary,involved,women,manufacturing,commitment,major,improved,ensure,food,achieve,industrial,services,mind,product,football,worker,top,director,improve,benefits,action,failure,trade,workforce,approach,teams,lack
    ==================================================

    text_19
    -------
    While it would be unlikely for a firm contractual commitment to be made which
    binds a record company to produce a promotional video, it is a matter of fact
    that a promotional video will be produced to support an artist's first single.
    With limited production costs, this video would fall into the £15,000 to
    £30,000 range, as opposed to the six-figure costs incurred by the established
    major artists. The cost of the promotional video for a developing artist would
    be recoupable against both audio and video income received by the record
    company. The income to pay these video costs is usually minimal with new
    artists, so these expenses are often set against future video exploitation. This
    is income which increases as the artist gains greater success and begins to
    release such items as compilation videos comprising selected promotional videos,
    or full length videos of live concert performances.
    ==========
    record,costs,video,music,cost,recording,tape,records,company,band,artist,companies,artists,sound,time,tax,deal,tapes,money,income,recordings,recorded,manager,studio,act,songs,cassette,major,recorder,label,album,publishing,people,discs,musicians,videos,radio,business,live,bands,contract,benefit,material,play,audio,incurred,basis,acts,machine,equipment,signed,disc,industry,benefits,sales,royalty,paid,machines,cassettes,royalties,success,expenses,amount,taxation,quality,set,producer,film,television,writer,studios,talent,system,camera,successful,recorders,cent,sign,labels,release,charges,tour,public,pay,independent,copyright,career,producers,editing,result,singles,account,albums,single,microphone,original,agent,top,songwriter,stereo
    ==================================================

    text_20
    -------
    Despite the challenges associated with building up large-scale production, the
    Japanese are forging ahead in display technology — and for very good reasons.
    Obviously the straightforward replacement of bulky cathode ray tubes with flat
    panel display leads to significant power and weight reductions as exemplified in
    the commercialisation of laptop computers. The most strategically important
    reason for investing in flat panel display technology, however, is that with
    continued miniaturisation of the integrated circuits the display itself will
    become the platform on which the system is built. This raises the prospect of
    fully integrated systems for which the sourcing of individual components such as
    drivers, memory chips and processors on the world market would no longer be an
    issue. Countries with such a display manufacturing capability would dominate the
    market and effectively eliminate competition based on older technology made up
    from discrete components.
    ==========
    companies,disk,market,industry,business,system,machine,firms,drive,computer,company,memory,board,hard,image,technology,ram,sales,time,markets,systems,components,video,growth,data,investment,products,development,major,circuit,software,world,power,performance,future,multimedia,screen,information,card,costs,images,windows,processor,drives,floppy,machines,manufacturing,quality,competition,production,share,expansion,unit,standard,electronic,range,competitive,light,industries,size,digital,electronics,increased,international,sector,local,operating,run,product,network,management,increase,success,box,printer,businesses,countries,financial,profits,monitor,set,result,disks,industrial,display,cost,based,difficult,disc,artwork,foreign,speed,main,supply,manufacturers,significant,recession,continue,current,profit
    ==================================================

    text_21
    -------
    Though less visible, it was export competition in goods and services which had a
    more fundamental effect on UK towns and cities. The internal economic geography
    of the UK has been reworked over a century by fundamental change in the nature
    and orientation of exports, which has reflected the success of individual
    industries and their factories. This demonstrates the principal changes so far this
    century in the composition of export goods. In 1900, the country was still
    largely dependent on exports of textiles, metals and coal, whereas by 1987
    nearly half the country's exports were accounted for by ‘machinery and
    transport equipment’ and chemicals. The impact of North Sea oil on the
    structure of the balance of payments may actually have reduced the absolute
    volume of manufacturing exports. This is because it raised the real sterling
    exchange rate, rendering ‘marginal’ manufacturing exports uncompetitive. We
    shall return to this issue at several points later in this volume.
    ==========
    trade,manufacturing,employment,industry,exports,imports,industrial,production,countries,industries,export,sector,world,economy,market,labour,jobs,economic,country,growth,prices,cent,products,import,exchange,decline,service,services,foreign,tonnes,markets,sectors,century,change,major,trading,workers,period,international,rate,domestic,price,tariffs,imported,currency,output,development,terms,demand,surplus,rates,million,oil,agricultural,total,national,increased,firms,unemployment,level,time,regions,grain,manufactured,increase,regional,balance,tariff,food,employed,steel,exported,deficit,shift,economies,united,producers,agriculture,share,importance,job,structure,government,dollar,rise,subsidies,transport,free,plants,main,levels,result,textiles,quotas,system,half,geography,sterling,net,raw
    ==================================================

    text_22
    -------
    As far as the Royal Navy were concerned the nuisance of excessive leakage was
    largely put a stop to when Sir Robert Seppings (1764–1840) introduced diagonal
    iron bracing into wooden hulls about 1830. Seppings, who used to say ‘partial
    strength produces general weakness’, seems to have been one of the first Naval
    Architects to have a clear mental picture of the stress systems in a ship's
    hull. In the merchant service wooden hulls were to a considerable extent
    replaced by composite and iron and steel construction after the middle of the
    century. A number of wooden ships continued to be built without adequate shear
    bracing, however, and such ships got more leaky as they got older, until, in an
    age when most of the pumping was done by hand, it became uneconomic to run them
    any longer. Up till 1914 Norwegian shipowners were still making money by buying
    up British sailing ships and running them with windmill pumps.
    ==========
    mill,ship,ships,sea,mills,strength,water,material,time,navy,fleet,stress,century,captain,naval,materials,crack,glass,surface,fracture,pipe,fibres,crew,vessels,port,vessel,built,coast,war,system,seamen,shipping,board,corn,royal,brittle,merchant,site,energy,voyage,sailors,strong,wheel,power,sailed,building,house,wood,fibre,admiral,sailing,age,iron,trade,strain,carried,weight,tensile,left,main,world,east,mechanical,company,cloth,sail,structure,cracks,times,money,home,cargo,tension,days,life,waters,length,load,machinery,cellulose,found,john,solid,steel,harbour,officers,island,local,run,buildings,people,result,tip,set,steam,ports,diamond,provided,wooden,process
    ==================================================

    text_23
    -------
    Clear out all your possessions and be ruthless. Now is the time to take rubbish
    to the dump, to give things away to charity shops and jumble sales. There is no
    point in taking all your useless rubbish with you. Also clear up the garden. You
    are not supposed to leave rubbish behind for the next occupants to cope with,
    although you can leave it bagged up outside the door for the dustmen to take
    later. If you are leaving the area do not forget to pick up any clothes that are
    at the cleaners, or shoes, clocks, or other items that are away being mended.
    You will also need to withdraw sufficient cash from the bank to pay for the
    removal. It is common practice to tip the people who have done the removal work
    so you may want to withdraw enough for this too.
    ==========
    bag,bags,time,account,plastic,paper,money,bank,people,packed,left,box,boxes,car,carrier,clothes,cash,found,home,suitcase,carrying,contents,luggage,cheque,days,set,carry,lot,pack,day,shopping,inside,pay,hand,cardboard,packing,items,pair,house,bottles,books,bought,rubbish,suitcases,door,carefully,paid,stuff,missing,wrapped,cheques,floor,contained,accounts,piece,couple,garden,picked,looked,empty,heavy,hands,payment,shop,pieces,sort,common,kit,boot,shoes,amount,packet,leave,stuffed,credit,carried,brought,hold,black,shops,rest,mind,idea,card,polythene,remember,parcel,pile,send,feel,pocket,half,arrived,bits,clothing,leather,brown,started,drawer,store
    ==================================================

    text_24
    -------
    Individual goals may well be in conflict with organisational goals even where
    there is a strong commitment to one goal by the organisation. It is worth
    repeating that there may also be competing goals within the organisation itself.
    Thus, for example, the prison service may wish to pursue the twin goals of the
    punishment of offenders  and at the same time their rehabilitation. These two
    goals may prove to be incompatible and yet each will have its supporters. Within
    the National Health Service there may well be a commitment to provide the best
    possible medical care that the state of medical knowledge will allow and yet
    this may be tempered by the requirement to act within tight financial
    constraints. The two goals may be in conflict. Many organisations will face the
    problem of which goals to prioritise in the light of competing goals.
    ==========
    health,objectives,goals,objective,conflict,service,achieve,organisation,services,goal,set,management,people,care,sentence,achieved,time,means,aims,organisations,authority,success,aim,achieving,step,court,offenders,hospital,structure,courts,prison,criminal,specific,conflicts,achievement,terms,medical,purpose,patients,individual,setting,process,change,justice,result,provide,involved,public,offences,organisational,sentences,offence,control,responsibility,task,community,level,role,magistrates,sentencing,act,imprisonment,managers,performance,strategy,probation,successful,practice,situation,behaviour,effective,action,staff,individuals,offender,system,national,planning,concerned,home,difficult,progress,targets,circumstances,activities,treatment,decide,plan,approach,hospitals,statement,term,range,environment,crime,relationship,local,personal,future,relationships
    ==================================================

    text_25
    -------
    On 25 July 1985 the dock company put in a planning application for the
    construction of a Roll on — Roll off (‘Ro-Ro’) terminal in the River
    Medway. Permission was refused, there was an appeal and an inquiry by an
    inspector whose recommendations the Secretary of State for the Environment
    accepted. The appeal was dismissed. The main consideration was undoubtedly the
    increase in heavy goods vehicles that would be generated by the new development
    and the consequent increase in noise levels, in particular night-time levels in
    Medway Road and Bridge Road. These environmental objections were considered to
    be serious enough to outweigh the economic benefits of allowing the proposal. It
    was this development and in particular the evidence given at the Ro-Ro inquiry
    which in due course prompted the council to bring the present proceedings. In
    March 1988 the council passed the necessary resolution and the writ was issued
    on 20 July 1988.
    ==========
    site,court,appeal,development,planning,council,port,local,decision,plans,building,road,land,company,scheme,build,increase,permission,application,construction,public,ferry,increased,house,proposed,built,inquiry,authority,project,dock,centre,judge,park,time,judgment,residents,ground,existing,facilities,held,ports,county,town,plan,district,cost,grounds,north,traffic,lords,proposal,access,environment,rate,effect,route,due,people,sites,major,ships,considered,law,harbour,cargo,issue,east,decided,level,shipping,granted,docks,act,power,justice,question,department,industrial,result,national,housing,lord,south,community,meeting,refused,matter,main,objections,developers,hearing,ferries,completed,developer,section,evidence,complex,planned,ship,station
    ==================================================

    text_26
    -------
    At the start of the exercise, the actual procedure was checked against a
    conceptual model that included the activities deemed necessary to achieve the
    agreed transformation. If the changes revealed by this comparison have not been
    made prior to the audit commencing, this could be the reason for the failure to
    meet the target levels of attainment. If, however, the procedure does comply
    with the procedure description derived earlier, then it will be necessary to
    subject each element or activity of the model to further scrutiny, for example
    by breaking them down to lower-order activities, or by auditing each element in
    the same manner as the parent procedure. This process is similar to work study
    exercises where measurable elements of a task are identified before the actual
    measurement takes place, and consideration is given to the resources required at
    each level, including the skills and experience of the operator.
    ==========
    information,system,time,analysis,systems,date,period,activities,management,performance,required,support,model,process,resources,situation,level,organisation,functional,basis,activity,notice,study,considered,control,terms,assessment,evaluation,practice,procedure,analysts,development,staff,exercise,concerned,departments,requirements,elder,functions,fig,main,ideas,review,carried,detailed,levels,filing,relevant,finance,stage,potential,factors,form,computer,monitoring,identified,objectives,procedures,effect,determine,approach,project,task,root,examination,client,effectiveness,definition,provide,effective,database,achieved,audit,requirement,elders,analyst,providing,planning,individual,tasks,taking,months,users,proposed,based,components,stages,measures,chapter,act,criteria,days,quality,manner,existing,earlier,related,relation,actual,assessing
    ==================================================

    text_27
    -------
    The Knights of the Blazing Sun were created after the Battle of Magritta in 1457
    during the crusades which eventually freed the land of Estalia from the Arabian
    invaders. The battle was a great victory for the Knights of the Old World, made
    all the remarkable by a strange and prophetic occurrence. During fierce street
    fighting around the temple of Myrmidia, the warrior goddess of Estalia, a group
    of knights found themselves surrounded by the dreaded Black Guard led by Emir
    Wasr the Cruel. Just as the Arabians closed in a sudden earth tremor shook the
    temple, dislodging a huge bronze statue of the goddess which plummeted to the
    street below crushing the Emir and many of his troops. The event was to prove
    the turning point of the battle. Afterwards, the surviving knights established
    the Order of the Blazing Sun with Myrmidia as its patron and protector.
    ==========
    temple,army,time,king,god,battle,sacred,goddess,found,ancient,gods,left,soldiers,street,temples,cult,head,dead,town,religious,ritual,enemy,horse,eyes,castle,miles,shrine,church,road,tomb,horses,day,troops,north,prince,built,south,fight,black,body,rode,sun,force,river,hundred,war,cavalry,city,sword,stone,led,killed,fighting,form,blood,thousand,night,news,events,fire,attack,centre,period,deity,house,set,camp,white,walls,main,worship,building,life,round,arms,west,reached,lord,tombs,days,figure,held,called,human,world,carried,brought,symbol,air,palace,cut,late,march,lay,earth,wall,royal,power,altar,event
    ==================================================

    text_28
    -------
    The answer to the first, or ‘why’, question begins with a recognition that
    banks are private sector, profit-making organisations with obligations to
    shareholders to increase profits over time. Thus they will always be looking for
    ways of expanding their balance sheets provided this leads to extra profit. Look
    again at Table 3.3 which shows the aggregate balance sheet of a large number of
    banks. Notice that assets are composed of various forms of lending: to the
    personal sector, the commercial sector, the government or the Bank of England.
    The liabilities side is dominated by deposits. Notice also that we can express
    any class of asset as a proportion of total assets or liabilities and remember
    too that in section 1.1.5 we said that these ratios are arrived at as a matter
    of deliberate choice and are assumed to represent portfolio equilibrium.
    ==========
    bank,public,private,banks,money,sector,market,deposits,assets,bills,government,financial,rates,discount,class,rate,funds,supply,time,liquidity,cash,monetary,balance,houses,lending,question,institutions,deposit,accounts,liquid,questions,company,notes,balances,credit,demand,loans,treasury,net,ratio,commercial,account,answer,markets,amount,profit,liabilities,borrowing,asset,authorities,exchange,issue,held,capital,banking,stock,form,hold,short,cost,sheet,base,system,sterling,surplus,personal,accounting,total,increase,basis,individual,operations,business,table,classes,issued,customers,loss,lend,companies,borrow,effect,bonds,bill,maturity,transactions,securities,economy,return,investment,period,means,policy,future,finance,services,building,cent,reserves,purchase
    ==================================================

    text_29
    -------
    Using the golfing tips he gleaned from such fine players, Andy soon had his
    handicap down to two. He was by then an assistant pro in its fullest sense, so
    he decided to try his hand at playing tournaments. Although he qualified for a
    few regional events, in fact he was aiming much higher: he wanted a crack at the
    Open Championship. So in 1973 Andy decided to try and qualify for the Open at
    Royal Troon — and it was here that an incident occurred that changed his
    career. He had played the first round, but before he had a chance even to hit a
    ball in the second he was out of the pre-qualifier, suffering from injuries he
    had received in a car accident with his caddie. Swallowing hard on the
    disappointment, Andy spent the next few years taking even more blows on the
    chin.
    ==========
    golf,round,green,hole,shot,play,tour,hit,won,tournament,par,time,car,holes,win,played,accident,day,tee,championship,players,ball,masters,player,playing,shots,game,professional,putt,club,caddie,cup,week,golfer,hospital,left,amateur,nick,yesterday,golfers,rounds,greens,driving,yards,champion,finished,world,driver,putting,clubs,practice,top,feet,crash,killed,road,short,jack,fairway,drive,putter,event,people,died,birdies,birdie,sandy,lead,golfing,happened,major,courses,home,head,injured,injuries,bunker,police,lost,missed,cut,couples,tournaments,final,royal,putts,days,winner,match,told,season,ambulance,hitting,winning,stroke,professionals,pro,record,set,tom
    ==================================================

    text_30
    -------
    Improve your mood and counteract stress: Ask anyone who exercises regularly and
    they will tell you that they always feel exhilarated at the end of a session —
    even if they had begun by feeling that they were not in the mood for exercise
    and had almost forced themselves to continue. Physical fitness also provides
    considerable protection against stress and the illnesses it can cause. So,
    however busy your life, perhaps you could try and fit some regular exercise into
    your day. Let it be something which is in complete contrast to the way you
    normally spend your time. One word of warning though: if you are someone whose
    daily life involves a strong competitive element, you would do well to avoid too
    much in the way of competitive sport (squash, tennis and so on) as your form of
    exercise as these will only tend to maintain an already high level of stress.
    ==========
    exercise,fitness,body,exercises,time,walking,training,muscles,physical,heart,walk,health,fit,day,aerobic,muscle,regular,life,minutes,weight,routine,strength,feel,programme,week,people,stamina,running,swimming,jogging,aerobics,rate,session,increase,activity,gym,stress,build,exercising,rest,stretching,sports,level,benefits,start,hard,healthy,times,sessions,taking,mental,improve,weights,normal,person,energy,begin,diet,active,vigorous,regularly,days,helps,pulse,shape,effort,increased,workout,gradually,mind,brisk,benefit,hour,activities,cycling,suppleness,feeling,enjoy,remember,easy,sport,strain,condition,fitter,blood,maximum,yoga,increasing,sedentary,period,athletes,form,fat,depression,pace,oxygen,amount,difficult,type,run
    ==================================================

    text_31
    -------
    I knew, however, that the top must remain thick. A simple 3/4in board is an
    anticlimax after all that architecture, and would ask ‘Why the fuss?’ A
    double thickness top adds the correct weight and importance. It is not, of
    course, 1–1/2in throughout. There is no need for that. Instead, in selecting
    the finest boards for the top, cut them over-length. After jointing and gluing
    (be careful where you stop and start your tongues), two pieces can be cut off to
    finish at four and a half inches each. These are mitred in to an extra front
    strip. A thinner strip runs between them at the back. This way, all the grain
    travels in the same direction and you do not store up shrinkage problems. They
    must all be wide enough to take the buttons which will hold down the top. Mould
    these pieces and glue them in place.
    ==========
    top,cut,bottom,holes,plastic,hole,piece,edge,metal,position,fit,remove,length,inside,base,left,surface,screws,wall,frame,wood,wire,cutting,tape,fitted,screw,strip,hold,glue,size,flat,time,edges,pieces,drill,plate,round,line,set,centre,joints,shape,square,mark,thin,fixing,strips,slightly,clean,steel,thick,diameter,required,panel,angle,removed,front,check,adhesive,hand,fitting,push,fixed,sharp,level,easy,material,joint,sections,simple,cover,half,method,section,smooth,larger,vertical,carefully,fix,sheet,rubber,ensure,knife,bolts,correct,horizontal,job,held,support,easier,firmly,hammer,thickness,width,board,easily,pin,bit,secure,lower
    ==================================================

    text_32
    -------
    The next three items cover different facets of designing for need. Martin, a
    student from another part of the college, a Higher Diploma course, reports back
    on the progress of the Garden Project (designing an accessible garden). The
    collaboration between the Design School and the multi-media group is, he says,
    working out quite well. There are some problems of communication and continuity
    (some multi-media students are full-time, some are part-time). However, there
    has been an interesting development. After initial experiments with raised beds,
    ramps and customised tools some lateral thinkers from both groups came up with
    the idea of a wheelchair with a seat which could be lowered to the plants at
    ground level. Models of the chair have already been built. Members of the group
    agree to document the project with photographs and notes and to continue it
    after the Design students graduate.
    ==========
    project,garden,students,university,student,gardens,projects,plants,time,model,gardening,development,college,study,library,seat,education,design,house,information,gardener,people,trees,level,staff,gardeners,team,schools,chair,provide,involved,skills,martin,science,multimedia,universities,planting,academic,school,lawn,models,major,plant,ideas,set,resources,campus,flowers,systems,degree,building,shrubs,summer,flower,designed,engineering,disabled,access,idea,system,world,courses,technology,seats,proposal,video,planning,digital,grass,space,planted,levels,grow,studies,computer,mature,equipment,research,successful,programme,nursery,scientific,success,roses,beds,potential,developed,growing,facilities,plan,disc,term,main,existing,graduates,department,fashion,including,engineer,centre
    ==================================================

    text_33
    -------
    Almost all accidents start with a simple error on the part of the pilot that
    leads to a chain of events, each of which makes the situation worse and an
    accident more and more difficult to avoid. The art of safe piloting is to learn
    to avoid the initial error whenever possible. But, if an error of judgement or a
    bad decision has been made, the vital thing is to recognise that, admit it and
    take immediate action to break the chain of events while a safe course of action
    is still possible. Forget the error or the cause of the problem and get on with
    correcting it and avoiding a worse situation. A similar situation occurs when
    soaring cross-country. Although you may get ridiculously low because of pressing
    on too hard, when, a few minutes later, you are back in the good conditions
    several thousand feet up, you must forget the wasted time and concentrate on
    flying normally.
    ==========
    events,time,error,event,errors,glider,pilot,speed,start,wind,people,ground,wing,flying,correct,landing,wrong,easy,rudder,difficult,pilots,check,aircraft,flight,launch,spin,stick,mistake,remember,gliders,occur,field,height,low,mistakes,experience,approach,nose,feet,situation,avoid,stall,stop,means,run,decide,result,extra,lift,position,job,happen,worth,feel,simply,wings,mind,normal,idea,matter,easier,makes,simple,bad,ahead,lot,close,hard,sort,quickly,correction,fly,cable,left,gliding,taking,safe,risk,change,climb,move,advice,forward,movement,hand,practice,easily,obvious,control,choose,prevent,straight,decision,link,thinking,leave,chance,recovery,money,air
    ==================================================

    text_34
    -------
    At death registration, registrars are instructed to make every effort to find
    out about the previous work experience of people, including those who might be
    unemployed or sick. But until changes in the registration of women's occupation
    were introduced in 1986 there was a major difference between men and women:
    ‘At the registration of the death of a child…the instructions to the
    registrars specify that the occupation…of a woman should not be recorded
    unless she has been in employment for most of her adult life.’ Bradshaw and
    Miller's work has shown that a substantial proportion of single mothers have
    never been in full time employment. A reasonable assumption to make on the basis
    of the instructions given to registrars before 1986, therefore, is that most of
    the deaths of children classified as unoccupied will have been registered by
    economically inactive lone mothers.
    ==========
    women,support,children,families,mothers,death,households,lone,people,household,parents,form,information,living,kin,family,details,time,parent,relatives,evidence,married,application,office,single,date,study,life,required,live,certificate,circumstances,person,copy,economic,address,age,care,employment,financial,found,patterns,send,die,studies,poverty,dependent,forms,income,dead,mother,register,copies,died,past,contact,registration,home,child,assistance,data,apply,provide,department,request,letter,couples,source,obtained,social,resources,provided,documents,including,elderly,arrangements,completed,telephone,return,days,received,period,suggests,receipt,complete,proportion,relative,applications,common,significant,personal,marriage,list,obtain,section,labour,receiving,wives,dying,money
    ==================================================

    text_35
    -------
    Developmental norms are an attempt to provide an indication of the ages at which
    one might expect ordinary children to show evidence of certain skills or
    abilities. Since children vary with respect to the ages at which they
    demonstrate any particular behaviour, norms represent an ‘average’ obtained
    from an examination of the developmental changes occurring in a large number of
    children. Data from a large sample will show the earliest age at which a child
    would be expected to gain control of a particular aspect of language, and the
    age by which 90 per cent or 95 per cent of non-handicapped children might be
    expected to show evidence of the same ability. If children who have already been
    diagnosed as suffering from some specific handicapping condition are included,
    the data will show the expected age delay before this group matches the
    performance of the normally developing children.
    ==========
    children,test,child,tests,parents,testing,cent,age,results,adult,scores,adults,tested,score,assessment,sample,performance,time,ability,items,measure,parent,validity,provide,found,childhood,school,family,intelligence,information,home,selection,study,average,measured,low,level,data,compared,basis,evidence,families,life,mother,mothers,based,response,mental,extent,positive,standard,aged,analysis,carried,reliability,development,measures,individual,difficulties,procedures,obtained,normal,depression,assessments,designed,procedure,methods,similar,result,studies,education,subject,care,disease,parental,scoring,assess,abilities,samples,research,social,shown,play,set,required,standardised,difficulty,scale,population,people,illness,pass,reliable,difficult,specific,expected,form,months,ages,babies
    ==================================================

    text_36
    -------
    Colborne conceded that he was fighting a losing battle; a battle against the
    entire social structure within the palace and the snobbery and jealousy of the
    Old Guard that surrounded the Prince. Colborne's departure was a shock to
    Charles. He was the one person within his household who had told him the truth;
    he had been his eyes and ears in the community, voiced the opinions of the man
    in the street. At times he had been his conscience too — when the Prince had
    lost his temper or been rude to someone, Colborne would write him a note and
    tell him so. He was devoted to the Prince, but he had served him for ten years
    and his wife had scarcely seen him. He was now fifty, and he felt she deserved
    more from her marriage. He left just a few days before Christmas in 1984.
    ==========
    prince,royal,princess,people,queen,time,battle,family,fight,life,palace,day,told,world,marriage,social,days,feel,public,hundred,friends,victory,wrong,win,lost,wife,won,love,fighting,bad,true,woman,night,duchess,husband,friend,fought,thousand,real,care,village,couple,mind,children,left,home,times,class,understand,words,community,private,struggle,hard,moment,mother,talk,war,ten,found,yesterday,house,live,stupid,sort,pounds,head,stand,close,book,worse,visit,rest,truth,hurt,hate,stop,person,defeat,meant,call,set,brought,angry,months,hope,duke,trouble,battles,simply,matter,twenty,eyes,happened,chance,power,women,reason,met,leave
    ==================================================

    text_37
    -------
    Most Third World countries are one-party states of one type or another and many
    are ruled through the routine exercise of physical force by the army and the
    police. This is not in the long term interests of global capitalism, and TNCs
    through their governments have been known to put pressure on dictators for the
    purpose of creating or restoring pluralist political systems. Capitalism depends
    on both the reality and the illusion of choice, but people are not fools and the
    global capitalist system offers many genuine choices. This creates many
    contradictions and paradoxes. In the previous chapter some general
    contradictions and paradoxes of economic, political and cultural-ideological
    TNPs were discussed. In this chapter the focus will be on the economic TNPs of
    transnational corporations, and the political TNPs of transnational capitalist
    classes in the Third World. The culture-ideology of consumerism in the Third
    World will be the subject of Chapter 5.
    ==========
    countries,world,chapter,force,development,economic,political,international,production,capitalist,global,developing,class,system,country,social,aid,power,society,capitalism,nations,capital,developed,forces,choice,labour,united,people,governments,real,government,means,section,economy,western,analysis,reality,time,discussed,book,military,control,relations,national,chapters,form,major,discussion,transnational,nature,terms,foreign,process,institutions,societies,main,poor,growth,resources,role,bureaucracy,industrial,elite,economies,army,study,life,south,politics,population,theory,concerned,aspects,forms,bank,classes,based,question,detail,rich,modern,public,human,systems,issues,west,subject,provide,account,consumption,choose,workers,attempt,trade,sense,basic,structure,level,view,attention
    ==================================================

    text_38
    -------
    The contexts of the other two examples is not recoverable since Kirchner does
    not give complete references. In both cases where the context is available
    however, the bare infinitive is used in reference to the undergoing of
    unpleasant treatment, where the speaker clearly wishes to stress the realization
    of a distasteful experience which was forced upon him. Substitution of the to
    infinitive gives a somewhat different impression: the events seem to be evoked
    in a much more resultative fashion — as the fact of having been made to
    scream, the state of Byron's feelings — that is, as an object of reflection
    rather than a recall of actual experience. While nothing definitive can be
    concluded from such meagre data, the fact that such examples do seem to suggest
    different impressions than the to infinitive to speakers of various dialects
    indicates that they deserve closer attention, especially in the light of a
    further examination of the passive voice.
    ==========
    infinitive,event,time,person,bare,verb,meaning,support,speaker,speech,verbs,evokes,sense,subject,fear,sentence,action,people,found,realization,form,dare,perception,relation,feelings,conceived,impression,evoke,feel,effect,express,represented,potential,voice,modal,book,means,life,occurrence,sentences,anger,experience,existence,language,result,examples,expressed,words,denoted,respect,movement,hand,potentiality,past,view,contexts,causation,type,implies,actual,emotions,construction,emotional,incidence,contrast,real,permission,simply,expresses,auxiliary,object,possibility,speak,feeling,denotes,similar,explanation,usage,prior,condition,context,relationship,direct,modals,evoked,position,beginning,mere,reaction,reference,negative,subsequent,idea,van,representation,love,dared,realized,analysis,referred
    ==================================================

    text_39
    -------
    ‘You're a cheerful bastard!’ I remarked, as we both ducked down into the
    trench. For the next few minutes I had to put up with Sid's reminiscences about
    how much worse it had been during the campaign in North Africa. The shelling
    continued until about midnight, then suddenly it stopped. The German guns then
    opened up but not to the same extent. They seemed further away, their shells
    passing over very high up and crashing into the area of the Orne canal. The
    German shelling lasted about twenty minutes, one gun continued to fire, starting
    with a clear crack, then the sound of the shell passing over, followed by the
    explosion as it hit the ground. I was somewhat fascinated by this German gun. I
    found myself listening for the distinct crack, then gazing up at the clear
    starry sky trying to follow the flight of the shell.
    ==========
    trench,time,piper,orchard,commando,brigade,road,village,commandos,wounded,positions,mortar,minutes,looked,front,evening,shelling,night,light,officer,trenches,direction,enemy,dead,jeep,short,left,day,close,ground,slit,hours,days,replied,mosquitoes,shells,bloody,trees,bagpipes,guns,remarked,attack,fire,distance,head,morning,gun,casualties,started,appeared,farm,entrance,lying,brigadier,entered,feet,house,shell,lot,yards,sleep,hour,officers,round,bastards,continued,passing,grass,burst,arrived,suddenly,yesterday,voice,sitting,dark,usual,past,shrapnel,team,half,darkness,pipes,couple,ten,rifle,bomb,explosions,sergeant,stopped,sound,wall,passed,doubt,sky,field,joined,moved,stood,fairly,south
    ==================================================

    text_40
    -------
    She'd been convinced all along that eventually she must lose him, that Marianne
    was right — some other attraction must inevitably draw him away. She hadn't
    changed her mind about that — a man such as Dane would always attract
    beautiful women, and Shannon could never hope to compete. But would the pain of
    losing him be any the less simply because she'd managed to hold him at bay?
    Eventually, probably sooner rather than later, he'd grow tired of waiting for
    Shannon, and then she'd be left with nothing, in any case. Though she could
    never let him know it, he already possessed her heart; if she were to give
    herself to him body and soul, at least the memories would be rich and ultimately
    fulfilling. Right now all she'd have to look back on would be frustration and
    longing suppressed by fear.
    ==========
    life,love,time,feel,feelings,fear,tears,loved,feeling,mother,woman,pain,anger,day,heart,told,world,mind,people,left,found,death,father,sense,child,lost,emotional,emotions,moment,home,understand,experience,grief,happy,past,eyes,hope,cry,days,friends,relationship,hurt,person,words,happened,women,bear,loss,guilt,real,sad,emotion,night,future,marriage,times,friend,true,change,wife,suffering,comfort,died,leave,brought,desire,live,angry,loving,deep,afraid,strong,hard,crying,lives,house,joy,family,body,strength,simply,despair,remember,return,suddenly,truth,memories,happiness,bed,sadness,husband,finally,terrible,thinking,knowing,difficult,believed,reason,deeply,looked
    ==================================================

    text_41
    -------
    There can be no doubt that for many women fear of loss is built into us by the
    way we've been reared. As children we may have been made to feel inadequate,
    silly or useless because we were never praised. In adult life, some may be
    submissive and ingratiating, expecting to be in the wrong, expecting to be
    discarded and unwanted. And surprise, surprise, they get just that sort of
    treatment. The only way to stop it happening, and therefore to stop the fear of
    it, is to develop self-esteem. Learn to be assertive, stand up for yourself and
    your own value. That way people will see you as even more lovable. That is what
    I mean by making fear your friend. If you are subject to these irrational fears,
    then use that fear as a trigger to change your attitude. It could revolutionise
    your life.
    ==========
    people,fear,feelings,feel,life,anger,emotions,emotional,feeling,person,love,time,experience,world,angry,relationship,sense,mind,emotion,learn,afraid,relationships,children,fears,understand,bad,lives,hurt,wrong,control,pain,childhood,change,past,experiences,real,true,beliefs,loss,negative,child,express,strong,ego,words,loving,personal,response,behaviour,guilt,makes,physical,women,simply,unconscious,adult,situation,hate,anxiety,reason,grow,told,process,create,form,live,parents,human,frustration,experienced,desire,difficult,conscious,talk,resentment,accept,hard,powerful,start,personality,feels,stop,reactions,partner,day,unable,choose,positive,truth,care,reality,expressed,woman,expression,hope,inside,stupid,bring,sort,rejection
    ==================================================

    text_42
    -------
    The prime document for EC statistics is now the VAT return. All who are engaged
    in intra-EC trade must now show thereon the total value of all goods dispatched
    to other EC customers and received from other EC suppliers in the special boxes
    provided on the return form. Where either category has exceeded £135,000 during
    1992 further, more detailed information has to be submitted within the very
    strict time limit of ten working days after each month end. Known as the
    Intrastat system, the data can be submitted by a computerised medium but only if
    it meets Customs specification requirements and has prior approval. Specific
    details relating to each consignment are required but values and quantities may
    be aggregated where all other details are identical. Up to ten items of coded
    information are required comprising such details as the commodity reference of
    the goods, delivery terms, weight, method of transport and, for arrivals, the
    country of origin.
    ==========
    data,information,stock,form,customer,details,date,time,trade,office,application,cash,required,invoice,copy,vat,supplier,retailer,total,note,address,department,delivery,certificate,items,send,forms,discount,received,item,sales,register,statistics,section,record,registration,analysis,obtained,special,check,price,payment,days,cost,invoices,receipt,amount,copies,apply,request,contact,figures,person,ledger,system,period,letter,census,procedure,till,issued,exports,complete,requirements,documents,returned,completed,return,file,provided,telephone,registered,including,day,list,local,applications,provide,records,entry,countries,imports,means,table,month,obtain,credit,control,warehouse,products,notice,relevant,include,suppliers,profit,customs,arrangements,staff,written,product
    ==================================================

    text_43
    -------
    Back home, the observation would have been no less apt. In the years leading up
    to the First World War the Hooligan embarked on a remarkable career, appearing
    in name if not in person before numerous governmental and semi-official bodies
    of enquiry. He loomed large in the apocalyptic discourse surrounding the fears
    of racial decline and physical inefficiency. He figured centrally in the
    Edwardian era's deliberations on the ‘boy labour’ question. He would crop up
    repeatedly in the anxious preoccupation with the demoralising influence of
    popular amusements, the collapse of ‘fair play’ sportsmanship, and the
    allegations of excessive ‘freedom’and ‘affluence’ that were levelled
    against the young. The name of the Hooligan, in fact, provided a crystallising
    focus for any number of overlapping anxieties associated with imperial decline,
    military incapacity, the erosion of social discipline and moral authority, the
    eclipse of family life, and what was feared to be the death rattle of ‘Old
    England’.
    ==========
    football,fans,war,violence,boys,hooligans,hooliganism,youth,hooligan,street,social,disorder,time,gang,gangs,police,behaviour,economic,people,world,supporters,political,crowd,life,soccer,society,crime,youths,respectable,rowdies,decline,streets,period,public,violent,terraces,matches,found,moral,common,fighting,rival,fights,juvenile,times,contemporary,traditional,government,family,history,game,delinquency,fight,trouble,late,power,territory,fears,evidence,economy,national,riots,class,fan,ground,panic,forms,led,set,questions,question,crowds,culture,sense,century,peace,popular,crisis,media,local,spectator,grounds,boy,town,united,authority,home,oxford,remained,aggro,major,death,postwar,brought,nation,road,bank,excitement,change,phenomenon
    ==================================================

    text_44
    -------
    In fact, as I soon discovered, these ruins are inhabited. I met the old lady as
    I was walking down a steep path out of the village. She was struggling up, bent
    under a heavy sack. We greeted each other. The skin of her face hung in purple
    folds and the old eyes were blurred with cataract. When I offered to carry her
    sack she waved me aside. Who was this impertinent stranger eyeing her baggage?
    We moved on up to her tumbledown tower on the last crag of the village. At the
    base was a terrace with one stool on it. Before us stretched an enormous view of
    mountain, promontory and shimmering sea. From my pack I offered her an apple,
    the only food I had. She dismissed it with a regal gesture. Then I saw her
    toothless gums. I left her in peace with her bundle, her stool and her majestic
    view.
    ==========
    sun,sky,bag,white,looked,trees,green,blue,day,eyes,dark,light,air,black,water,sir,time,stood,grass,hair,morning,bags,left,red,grey,round,sat,house,walked,head,master,bright,village,rose,fields,found,hand,lay,wind,night,sea,brown,clouds,summer,hills,days,lady,beautiful,pale,set,warm,home,feet,stone,teeth,hot,river,hands,heat,evening,john,leaves,woman,road,golden,brought,cloud,deep,ground,past,silver,beneath,edge,cold,sunlight,tall,plastic,gold,earth,huge,slowly,yellow,afternoon,hill,people,door,tree,forest,paper,cool,birds,watched,mist,low,flowers,valley,thin,smiled,life,wall
    ==================================================

    text_45
    -------
    Such integration can be largely formal; in Lesotho, for instance, the evidence
    of real integration in between Mathematics and Science is very slight. On the
    other hand it may represent a genuine attempt by specialists in related subjects
    to sit down together and plan a programme which allows for separate activities
    but suggests common themes and provides examples of integrated lessons as in the
    Nigerian Cultural and Creative Art syllabus. Yet again it may be the product of
    basic rethinking and true integration founded on new objectives and a fresh
    approach as in the Social Studies syllabus now under development in Sierra Leone
    where an integrated programme with significant regional variations is being
    planned in a series of central and local workshops and where a special series of
    booklets on skills development (e.g. map making, note taking skills, creative
    skills) is being produced for teachers.
    ==========
    curriculum,pupils,school,teachers,education,schools,national,teaching,learning,assessment,skills,mathematics,development,children,regional,teacher,subjects,attainment,subject,primary,study,region,time,differences,secondary,range,science,pupil,content,educational,programmes,individual,regions,level,knowledge,local,art,process,activities,programme,experience,levels,information,structure,taught,courses,form,communication,innovation,common,people,ideas,classroom,opportunities,targets,thinking,key,creative,achievement,language,variety,based,media,develop,materials,terms,planning,core,set,understanding,approach,similar,aims,central,ability,report,features,technology,syllabus,pattern,emphasis,aspects,stage,elements,studies,social,plan,curricular,training,framework,statements,progress,history,age,patterns,basic,including,wide,creativity,arts
    ==================================================

    text_46
    -------
    Regarding access to health care, we meet the fact that women usually live longer
    than men. This is one area of life in which women have a definite advantage! It
    would appear that access to the health service is reasonably equitable between
    men and women, and that women's longer lives should not be attributed to
    prejudice against men in the health sector! However, some writers have suggested
    that the diseases commonly found among men are treated with greater concern and
    more expensive medical treatment than those more commonly found among women. For
    instance, attention has recently been drawn to the inadequate provision of
    screening for cervical cancer despite the fact that this service could provide
    the means of identifying early forms of the disease before it reaches its
    incurable and lethal stage. (More discussion of women and health can be found in
    chapter 9, section 9.5.)
    ==========
    health,women,care,cancer,medical,services,male,woman,people,female,chapter,public,disease,education,social,patients,service,national,stage,illness,feminist,time,life,tumour,family,role,children,medicine,private,primary,tumours,healthy,ill,promotion,poor,conditions,programmes,population,development,doctors,study,mortality,found,prevention,community,workers,research,attention,sector,section,gender,sex,term,major,issues,society,main,feminists,policy,screening,terms,book,status,living,feminism,concerned,aspects,diseases,practice,treatment,quality,authority,discussed,clinics,government,analysis,importance,world,studies,risk,cell,mothers,provide,chapters,cancers,programme,process,discussion,improve,improved,information,sexual,preventive,support,report,factors,common,access,recently,power
    ==================================================

    text_47
    -------
    The Dinner or Luncheon Party: Whatever time of day it is, this is most likely to
    mean inviting a group of people over for a ‘sit-down’ meal. The grandness of
    the meal, and how much of it you pay for, depends upon the expectations of
    yourself and your guests and perhaps their relationship to you. If, say, you are
    a young person — student or worker — who has invited over friends of the
    same age, they will probably expect to bring a bottle of wine with them. In
    fact, most friends, of any age, would bring a bottle of something — unless the
    dinner party was very grand. Relatives often seem to feel that they do not need
    to bring a contribution, unless, of course, you are young, living alone for the
    first time and being visited by your mother, in which case she will probably
    bring a month's supply of food and wash up for you as well!
    ==========
    people,party,dinner,evening,time,guests,friends,home,day,night,money,house,age,family,hotel,life,table,mother,invited,person,week,social,wife,lunch,met,found,arrived,parties,pay,lady,days,guest,food,friend,ladies,told,drink,talk,feel,champagne,round,occasion,meet,left,meal,late,daughter,enjoyed,wine,conversation,spent,host,company,elderly,afternoon,visit,husband,hall,invitation,morning,brought,paid,job,counselling,care,dancing,tea,drinks,glass,parents,father,children,pleasure,happy,experience,hospitality,feelings,girl,restaurant,private,staff,dance,couple,support,relationship,special,living,women,difficult,arranged,live,personal,lives,counsellor,buy,dining,cost,hour,spend,enjoy
    ==================================================

    text_48
    -------
    The implementation of care management in April could rapidly illustrate how the
    admirable intentions of the government's community care policy might founder on
    the unintended consequences of more powerful forces and contradictions. Firstly,
    although the transfer of social security funds will allow more needs driven
    services, it will also cash limit expenditure. Secondly, this transfer punishes
    local authorities with few residential care homes and cuts off money for future
    expansion. Thirdly, the directive that care managers should not themselves give
    direct care runs counter to the core of good social work practice and creates a
    new corps of care administrators, thereby reducing the number of staff available
    to give direct care. Fourthly, no central guidance has emerged on how to
    coordinate at the local level, care management, the care programme approach, and
    hospital discharge procedures, thus inviting triplication of planning effort.
    ==========
    care,social,services,community,health,service,people,local,workers,expenditure,government,spending,budget,assessment,authorities,residential,policy,public,support,worker,management,effect,practice,authority,clients,effects,resources,client,mental,staff,provision,development,department,approach,planning,agencies,individual,carers,voluntary,time,users,cuts,provide,departments,home,money,professionals,system,team,sector,set,elderly,professional,policies,key,national,teams,role,provided,act,day,level,welfare,direct,plans,training,information,managers,statutory,hospital,research,central,increase,homes,range,practitioners,billion,specialist,plan,financial,arrangements,specific,develop,implementation,programme,process,budgets,finance,assessments,doh,issues,manager,result,person,control,responsibility,joint,monitoring,change,real
    ==================================================

    text_49
    -------
    It was a great discovery. But it was utterly disastrous for classical physics.
    An electron encircling a nucleus is continuously subject to acceleration as its
    velocity keeps on changing direction. (Acceleration is just the rate of change
    of velocity.) It is an inexorable consequence of classical physics that such an
    accelerating electron radiates off some of its energy at a frequency
    corresponding to the frequency of the electron's circulation. This causes the
    electron to move closer to the nucleus and changes the frequency. The radiation
    loss continues. In other words, a classical "solar system" atom under
    electromagnetic forces is nothing like the actual solar system held together by
    gravitational forces. The atom would be unstable, as its electrons spiralled
    ever closer to the nucleus, and it would emit its dying radiation in a band of
    frequencies with no trace of discreteness. The nuclear atom dealt
    the coup de grâce to classical physics.
    ==========
    particles,quantum,theory,electron,particle,light,energy,physics,mechanics,electrons,waves,matter,called,time,mass,proton,electromagnetic,classical,change,wave,principle,atoms,experiment,sound,physicists,atom,experiments,position,energies,theories,quarks,nucleus,physical,decay,weak,nuclear,system,momentum,results,protons,photon,interactions,atomic,uncertainty,found,measurement,spin,equation,produce,radiation,force,result,means,forces,motion,world,velocity,bat,calculations,unified,speed,mathematical,objects,effect,fundamental,times,idea,similar,frequency,physicist,relativity,wavelength,terms,properties,bats,single,field,theoretical,produced,measure,range,beam,predicted,charged,photons,experimental,amount,direction,detect,rate,mechanical,probability,universe,slit,form,strong,polarisation,frequencies,gravity,predictions
    ==================================================

```python
vocabulary = corpus_data['vocabulary'] #open(cache_fullpath('bnc_vocab_49328.txt')).read().split()
vocab = datautils.Vocab(vocabulary)
recalled_words = sorted(set(
    pandas.read_pickle(cache_fullpath('brisbane_06b643a_recall_results.pkl'))['word'].values)\
                        .intersection(vocabulary)
                       )
```

```python
predictive_probabilities = []

text_names = sorted(posterior_predictions.keys(), key=lambda arg: int(arg.split('_')[1]))

for text_name in text_names:
    f = []
    for word in recalled_words:
        f.append(posterior_predictions[text_name][vocab.word2index[word]])
    predictive_probabilities.append(f)

predictive_probabilities = numpy.array(predictive_probabilities)

predictive_probabilities = numpy.c_[predictive_probabilities, 1-predictive_probabilities.sum(1)]

header = ','.join(recalled_words + ['ALTERNATIVE_WORD'])

M = [header]
for i,f in enumerate(predictive_probabilities):
    M.append(text_names[i] + ',' + ','.join(map(str, f)))
M = '\n'.join(M)

posterior_predictions_of_recalled_words = 'posterior_predictions_of_recalled_words.csv'
```

```python
with open(cache_fullpath(posterior_predictions_of_recalled_words), 'w') as f:
    f.write(M)

# Verify the integrity of the exported csv file.
assert utils.checksum(cache_fullpath(posterior_predictions_of_recalled_words))\
    == 'd8a4155b3e8d04331ddf6c791188653b4c9612f8d395ecca286bde6983a28743'
```

```python
V = {v:i for i, v in enumerate(corpus_data['vocabulary'])}

posterior_predictions_demo_fname = 'hdptm_201117172636_2290_posterior_predictions_demo.csv'

def get_posterior_predictions(K=100):
    pp = []
    for text_id in sorted(posterior_predictions.keys(), key=lambda args: int(args.split('_')[1])):
        phi = posterior_predictions[text_id]
        words_in_text = topicmodels.text_to_words(texts[text_id], V)
        indices = phi.argsort()[::-1]
        for index in indices[:K]:
            pp.extend([(text_id,
                        corpus_data['vocabulary'][index],
                        phi[index],
                        corpus_data['vocabulary'][index] in words_in_text)])
    return pp

pandas.DataFrame(get_posterior_predictions(),
                 columns = ['text', 'item', 'probability', 'present']).to_csv(
    cache_fullpath(posterior_predictions_demo_fname),
    index=False
)

assert utils.checksum(cache_fullpath(posterior_predictions_demo_fname))\
    == '8cc6b290807e52fdb71b950a552955d679f0331fa45811f0f0d3dd9884d29c2f'
```