The Y Committee’s parent body, the Y Board, was reconvened from February to March 1941 and was composed of ‘C’ and the service directors of intelligence. It examined all interception or Y work including both communicative and non-communicative (e.g. radar and navigation beacons) emissions, and even the study and recognition of individual Morse operators. The Y Board concluded, with regard to GC&CS, that the technical characteristics of cryptanalysis precluded any increasingly direct service branch intervention in its internal operation than already was the case (through the GC&CS service sections and MI6 circulating sections). By the same token, however, it did endorse the closer integration of traffic analysis and cryptanalysis, and in due course traffic analysis proved a very valuable auxiliary method to the production of Ultra. The Y Board in turn was to be responsible for co-ordinating the two sides of the process on behalf of the Chiefs of Staff, and was supposed to meet every six to eight weeks. The service intelligence directorates were each to attach an intelligence officer to a Y sub-committee concerned strictly with interception, and likewise to a cryptanalysis sub-committee intended to be ‘run in parallel’ with the Y sub-committee. The chairs of the two sub-committees were in turn appointed as members to the Y Board. In the event, the obvious duplication between the two sub-committees eventually led to the cryptanalysis sub-committee petering out as its duties were subsumed by an additional Enigma sub-committee created in March 1941.
In an attempt to address the concerns of his consumers in Whitehall about their access to, and control of, cryptanalytical product, Denniston set up an additional section within GC&CS called the Interservice Distribution and Reference Section. This section would also include representatives from the service branches to help ensure that their interests were duly considered in the circulation of GC&CS product. Despite these attempts to incorporate consumer demand into the day-to-day operation of the service, the Admiralty in turn remained relatively dissatisfied. In an effort to increase the forcefulness of their representation at Bletchley, they attached an assistant director of naval intelligence to GC&CS. In practice, however, he was actually based at the Admiralty’s Operational Intelligence Centre (OIC), albeit making regular visits to Bletchley, and received daily reports from the navy section by telephone.
One can see, therefore, that GC&CS was very much an assortment of semi-independent sections with divided loyalties and subject to lines of dual control between GC&CS and their departments of origin. The organizational politics of intelligence management were very similar in both GC&CS and MI6. Where the two organizations differed most dramatically was in their relative success as the war developed. While MI6 lost most of its continental assets during the fall of Europe in 1939–40 and spent much of the war trying to regain lost ground, GC&CS developed a chain of successes, central of which was the successful penetration of the Axis high-grade codes and ciphers, now famous as Ultra. Hence, the difficulties of MI6 arose from the unenviable combination of escalating demand and dwindling supply. On the other hand, while GC&CS found itself in possession of a rich vein of raw intelligence (plus or minus occasional ebbs and flows as the fortunes of cryptanalytical war came and went), it was confronted by severe overload of already strained facilities combined with growing demand that actually seemed to outpace even the richest outpouring of the intelligence product. As a result, GC&CS quadrupled in size between late 1939 and early 1941 when it reached a staff of 900. With continued success, its size continued to expand to 1,500 in 1942.
At the outbreak of war, GC&CS had been composed of a combination of Foreign Office and Service Branch professionals coupled to an assortment of ageing but productive Room 40 alumni of First World War vintage. In the new population there was an exotic assortment of civilians, amongst which the official history counts ‘professors, lecturers and undergraduates, chess-masters, experts from the principal museums, barristers and antiquarian booksellers’. The result was a struggle to keep up with the flood of new faces and personalities, and to keep some semblance of orderly process. As the official history notes, ‘At the beginning of 1941 it was by Whitehall standards poorly organized … new sections had to be improvised into existence in response to the needs and opportunities thrown up since the outbreak of war.’ The result was ‘a loose collection of groups rather than … a single tidy organization’, words which almost exactly parallel Vivian’s description of MI6 in the same period. The situation was intensified by the fact that senior officers still retained the pre-war practice of performing both cryptanalytical as well as administrative tasks. An additional source of friction was the fact that the new and relatively ‘undisciplined’ wartime staff were less familiar with the traditional departmental and ministry control over intelligence analysis, and were prone to stray into areas of interpretation and assessment consumers viewed as their own domain.
By early 1942, GC&CS found itself all but overcome by its own internal management problems, partly driven by a new and unmanageable size, partly by a progressive erosion of traditional institutional and administrative boundaries, and partly by escalating efforts of the Service customers to keep a hand in the day-to-day operation of the organization. GC&CS reached a crisis point in the autumn of 1941, forcing Menzies to appoint a Joint Committee of Control drawn from both MI6 and GC&CS. However, like so many of Menzies’ administrative initiatives, the committee proved unequal to the task, and – despite the obvious dangers of going over the heads of their superiors – four leading cryptanalysts were forced to appeal directly to Churchill. Despite this drastic action, matters remained unresolved until January 1942.
It is worth keeping in mind that this kind of difficulty as a result of too rapid success was not wholly unique to GC&CS. During the same period, and also partly as a result of GC&CS successes, in this case against Abwehr ciphers, MI5 experienced a similar overload crisis. With the successful penetration of the German espionage effort against the UK that took the shape of the now-famous Double Cross programme, MI5’s operational side, B Division, found itself a vast and tottering mass of ad hoc groups and sections, trying to cope with the volume of work brought on by Double Cross. It also experienced management bottlenecks where staff and procedures were not equipped to handle the volume of materials generated by both counter-espionage Sigint, double-agent operations, and a flood of reports from around the British Isles of suspected spies and saboteurs. Where MI5 differed from GC&CS, however, was that it was designed primarily as an investigation service and not as an intelligence producer. MI5 did not have a brace of powerful Cabinet-level customers demanding their respective pounds of flesh, and was not composed of a staff subject to the divided loyalties of dual control between the service and its consumers. The demands of Bletchley Park’s consumers intensified its difficulties with overload well beyond that experienced by the Security Service. What MI5 needed was a strong central hand of control, which it eventually received in the form of Sir David Petrie as Director-General. No such solution was available to a GC&CS which existed to serve many masters rather than one. Although the service intelligence branches increasingly ceded direct control of GC&CS to the organization itself and to ‘C’ prior to 1941, debates over the circulation of what amounted to an embarrassment of Ultra wealth set matters back considerably.
One of the peculiarities of intelligence supply and demand in wartime is the absence or even reversal of the law of diminishing marginal utility. Under this old standard of economic theory, a thirsty man derives more utility from his first mouthful of water than from his last, by which time he is sated and drinking ceases to be a source of pleasure. The additional utility of each additional swallow diminishes until there is no more utility to be had. On the whole, this theory holds quite nicely for most products, from food to household computers to television comedy. In the case of intelligence, and especially in wartime, the process is almost reversed, as each intelligence report of the calibre of Ultra creates an increased appetite for more of the same, with no real upper limit in sight. One cannot really imagi
ne the Admiralty’s OIC turning around to Bletchley Park and saying ‘that’s all the Ultra we need thank you, we’ve had quite enough now’. The result was that as supply increased, demand increased rather than decreased, and the armed forces’ desire for a direct hand in the running of things that had been on hold for a time increased likewise.
As far as the internal workings of GC&CS were concerned, this was particularly apparent with the army and air sections, the Admiralty having made something of a ‘separate peace’ with Bletchley Park through its appointment of an OIC-based Assistant Director of Naval Intelligence. The army and air sections were subject to a particularly keen sense of divided loyalty between GC&CS and their own services. This was demonstrated most clearly in October 1941, when the Director of Military Intelligence and his RAF counterpart demanded what the official history described as ‘total operational control of the staff engaged in translating and elucidating the decrypts, and selecting from them those which should be passed to Whitehall and operational theatres’. To complicate matters, this demand was supported by the military and RAF circulating sections (Sections IV and II respectively) at MI6. The irony of this development was that the Sigint service branch officers themselves fell to quarrelling like thieves over the division of the spoils, and this intervention too ended in deadlock.
As internal solutions to GC&CS’s internal problems were not forthcoming, Menzies was forced to initiate an independent inquiry by a former deputy director of military intelligence. In February 1942, Menzies implemented the inquiry’s recommendations. The Joint Committee of Control was disbanded, and the civil and military sides of GC&CS were drawn apart into two distinct directorates under ‘C’. The sub-division of GC&CS largely resolved the span of control problems which had come with frantic expansion, and relieved some of the crowding problems at Bletchley Park as the civil and diplomatic sections of GC&CS were rehoused in quarters in Berkeley Street, London. The service sections came under a new post of Deputy Director (Services), filled by Commander Edward Travis, who subsequently received replacements for the civilian administrative staff that had been drawn from MI6 and who relocated to Berkeley Street under Denniston – moved sideways but effectively demoted, to become Deputy Director (Civil). This solution was not, however, without its costs. In creating two Directorates under ‘C’, the post of a single operational head of GC&CS had to be abolished.
Civilians who remained with the service directorate at Bletchley Park were given formal authority over armed service personnel working under them. Finally, differences over the control of Ultra were to be settled by the appointment of a head of section responsible for distribution and answerable directly and only to Travis.
GC&CS continued to grow rapidly, with continued managerial difficulty resulting, albeit not on the scale of the 1941 crisis. By summer 1943, the staff had increased to 5,052 (from 2,095 the previous summer). In June 1944 they numbered 7,723, of whom 3,371 were civilians and 4,352 service persons. Numbers peaked in January 1945 at 8,995. The solution to these management difficulties can only have served to intensify the friction felt over the 1942 reorganization. Menzies redesignated himself Director-General and promoted Travis as overall Director of GC&CS while Denniston continued to languish in the hierarchy as Deputy Director (C). These arrangements prevailed until the end of the Second World War.
After the war, GCHQ managed to escape from the control of ‘C’ and disengage itself from the even more fraught internal management problems of MI6. It swallowed up what had been the wartime Radio Security Service, although it was divorced from the London Communications Security Agency until their eventual re-amalgamation in 1969. In looking at the internal structure of the postwar GCHQ, it is impossible not to see the legacy of the hard lessons of Bletchley Park, Ultra and the Second World War.
The Cold War GCHQ continued to serve a brace of consumers in Whitehall, as well as foreign but allied collaborators in the UKUSA ‘special relationship’. As such, its structure has still had to cope with the importance of customer requirements, but also take into account the dangers of insistent and intemperate customer demand when it interferes with the bread and butter work of Sigint. As a result, what we see in the Cold War GCHQ is a division – like that of the Cold War MI6 – into five main directorates or Divisions: H Division, consolidating cryptanalysis into a single administrative entity; J and K Divisions handling the operational work of Sigint production, J Division handling the Soviet Bloc and K Division the rest of the world; X Division providing specialized computing services (GC&CS was, of course, the birthplace of the first semi-programmable electronic computer, Colossus, for attacking Tunny signals); and finally Z Division responsible for Requirements and Liaison, handling links between GCHQ and its customers in Whitehall and its allies in the UKUSA Sigint alliance. Under these arrangements, it was able to retain its links to customers in Whitehall and Downing Street through Z Division, but without quite the same problem of divided loyalties, as liaison with consumers was divorced from the practical work of doing Sigint.
The structure of demand in government circles also changed, with an increasingly powerful JIC in the Cabinet Office from 1957. From there the JIC has since been in a position to arbitrate between competing demands for intelligence among customers, and empowered to lay down clear and agreed national intelligence priorities through the annual National Intelligence Requirements Paper. Of course, whether these smoothly oiled mechanisms would run quite as slickly in a case of crisis of national survival comparable to the Second World War has never really been put to the test, and hopefully is unlikely to be so tested in the foreseeable future. Nonetheless, the experience of the Second World War, of the problems and crises created by unexpected success, proved as vital to creating the postwar British intelligence system as the only slightly harder lessons learned from unavoidable failure. During those glory years of Ultra at Bletchley Park, GC&CS and its masters and customers in the British Government were forced to identify genuine weaknesses and difficulties in their traditionally collegial way of doing things. Solutions had to be found that allowed the intrinsic problems to be resolved, or at least minimized, without sacrificing the strengths of that way of doing things. The solutions were not unalloyed good or bad ones, but risks and trade-offs that, overall, served admirably well and provided that vitally necessary institutional setting for what was undoubtedly the jewel in Britain’s wartime intelligence crown.
22
COLD WAR CODEBREAKING AND BEYOND: THE LEGACY OF BLETCHLEY PARK
RICHARD J. ALDRICH
Introduction
The postwar Soviet Union and the threat it posed to the western democracies dominated future planning for the British intelligence and security services throughout 1944 and 1945. MI6 began looking towards Moscow as the main postwar enemy, setting up a small anti-Soviet section under the service’s rising star Kim Philby, later revealed as ‘the Third Man’ in the Cambridge spy ring. The codebreakers also began looking to their future. Travis set up a small committee comprising Harry Hinsley, now one of his key aides; Gordon Welchman, the head of Hut 6; and Edward Crankshaw, who had spent time in Moscow dealing with the Russians on Sigint. They pressed for a combined foreign intelligence organization, taking in both Sigint and human intelligence, a logical development of the situation that already existed in the control by ‘C’ of both GC&CS itself and of the distribution of its material. In the event, the opposite occurred. The postwar successor to Bletchley Park discarded both the links to MI6 and its old name, adopting the wartime cover name of GCHQ as its new title. It moved first to Eastcote in north London, and later to Cheltenham, as an independent Sigint organization, separate from MI6 although still under Foreign Office control. It remained highly secretive. Its existence only became widely known in the 1970s and 80s through a series of trials over leakage of Sigint secrets and a badly handled bout of industrial action, which led to a number of workers being sacked. This chapter by Professor Richard J. Aldrich shows that, despite the obsessive secrecy s
urrounding GCHQ, there is a good deal that can be learned about it through careful research in the British and US archives.
MS
It is all but impossible to draw a distinction between Bletchley Park’s work on wartime Germany and its growing work on the Soviet Union in the 1940s. Knowledge of wartime Germany required the tracking of events on the eastern front and involved learning as much as possible about the Soviet effort. British intelligence began to value the Germans for their knowledge of the Soviet Union as soon as Ultra came onstream. German messages used to send their own Sigint summaries about the Soviet Union back to Berlin were, in turn, intercepted by the British. This ‘second-hand’ Sigint proved to be London’s best source on the performance of the Soviet forces. As early as 1943 the Joint Intelligence Committee (JIC) – Britain’s highest intelligence authority – was able to produce detailed and accurate reports on the capabilities of the Soviet Air Force, based on Luftwaffe Sigint material.
The Bletchley Park Codebreakers Page 43