James Milson

An example of a version of the family tradition follows from the Sydney Morning Herald of 19 May 1926.[23]

Fellow passengers on Albion with James Milson included Robert Campbell (1769–1846) and his family, and his nephew Robert Campbell Jnr.[6] In the long voyage the Campbells and James Milson got to know each other well. Robert Campbell was a successful merchant who also had farming interests. Robert Campbell owned land that including 900 acres (364ha) at Canterbury within six miles south-west of Sydney where he ran the largest private cattle herd in the Colony,[22][43][44] and an undeveloped 120 acres (48ha) on the headland on the north side of Port Jackson that includes both Kirribilli Point and Milsons Point.

James Milson was immigrating to begin life in the Colony as a farmer. Initially before he could obtain a land grant of his own he needed to obtain employment. A court case between Campbell and Milson in 1831 stated that Campbell was a former employer of Milson.[16] It therefore appears that James Milson had a job with Robert Campbell on Campell's Canterbury farm even before stepping onto the shore of his new homeland.

Milson next found employment at the Field of Mars in the District of Parramatta. References do not agree as to which farm he worked on in the area.

On 8 January 1810 at St Philip's Church, Sydney, Milson, describing himself as a described himself as "servant and labourer", married Elizabeth Kilpack (1793–1850), the daughter of David Kilpack (c. 1757 – 1797) and Eleanor McDonald (c. 1754 – 1835), who at the time of her daughter's marriage was the wife of Thomas Edward Higgins (c. 1740 – 1829).

The Australian Dictionary of Biography states that Elizabeth Kilpack was the daughter of Milson's employer, without stating who Milson's employer was.[2] Some interpret this to mean that Milson was working on the farm of Elizabeth's father David Kilpack. This, however, is impossible as David Kilpack died in 1797 which was 9 years before Milson arrived in the Colony, and before Kilpack died he had sold his farm to John Macarthur (1767–1834).[45] Elizabeth Warne says that Milson worked on the farm of Elizabeth's mother, the "widow Kilpack", a farm of 170 acres.[1] This again is impossible as prior to 1816 Elizabeth's mother never owned a farm, and she was also only the "widow Kilpack" for 14 months till her second marriage to Thomas Higgins on 31 January 1799, although she was still at times identified by her maiden name of Eleanor McDonald (1822 and 1825 musters) and her former married name of Eleanor Kilpack (land grant of 1816). (Elizabeth Warne also incorrectly states that Milson worked on this farm before 1810 at the same time as working on his own farm of 50 acres opposite Sydney Cove when he did not receive the grant for this 50 acres until August 1824.[19]) There then only remained Elizabeth's step-father Thomas Higgins. The 1806 muster, however, shows that he only had a farm of 30 acres and records in the Colonial Secretary's Index show that he did not acquire another 100 acres until July 1809.

The Beecroft and Cheltenham History Group states instead that James Milson had worked on Cornish Hills Farm when he first arrived as a free settler in 1806.[45] With the understanding that James Milson's first employer in the colony had been Robert Campbell at Canterbury, this is the most likely scenario of Milson's second workplace at the "Field of Mars". The Cornish Hill Farm was owned by John Macarthur. By 1803 John Macarthur had acquired a total of over 1000 acres at the "Field of Mars" being a number of smaller farms that he called the "Cornish Hill Farms", in an area that extended from today's Dundas through Carlingford and Beecroft to Thompson's Corner in Pennant Hills at the junction of Castle Hill and Pennants Hills Road. On Macarthur's Cornish Hills Farms, which included the farm that had originally belonged to the father of Elizabeth Kilpack, John Macarthur employed farm managers for the various farms and for various farming tasks. Two of these farm managers had been David Kilpack, the father of Elizabeth Kilpack, from the sale of his farm until his death in 1797, and Andrew Murray, a friend and brother-in-law of James Milson, after Murray's arrival in the Colony in 1817.[45]

Other collaborating evidence that James Milson had been employed by John Macarthur includes that:

• When James Milson received his first land grant in 1816 he was recommended for this grant by "H McArthur", the nephew of John Macarthur.[46]
• When James Milson received a subsequent land grant of 100 acres at Pennant Hills in 1821 (he already had 100 acres in that area), it had been 100 acres of the Cornish Hills Farm that John Macarthur had surrendered to the Crown in May 1821, and land that James Milson stated that John Macarthur had requested be granted to James Milson.[47]

• In a dispute with James Shepherd over ownership the 100-acre land grant that had been part of the Cornish Hills Farm, Milson chose John Macarthur as his arbitrator.[48]

James Milson met his wife Elizabeth Kilpack while working on Macarthur's Cornish Hills Farms, as Elizabeth Kilpack was living prior to her marriage at the age of 16 on her step-father's 30-acre farm in the area. Her family also continued to have a close association with the Macarthurs as when her mother received a grant of 60 acres in 1816 the person who recommended for the grant was Mrs Macarthur. Andrew Murray, who married in 1818 a year after arriving in the Colony, also met his wife Eleanor Kilpack, Elizabeth's sister, while working at the Cornish Hill Farms. According to the Beecroft and Cheltenham History Group it is said that Andrew first met Eleanor while out herding cattle at Cornish Hills Farm.[45]

James Milson's first land grant, of 50 acres, was granted to him on 16 January 1816 when it was recorded that he was living in the District of Parramatta (which included the "Field of Mars") and had a wife and 2 children.[46] These 2 children were Sophia (1811) and James Jnr (1814).[35] They were to be followed by David (1817), Elizabeth (1819), John (1821) and Robert (1824).

This first grant was for 50 acres at Broken Bay.[46] Broken Bay is the entrance of the Hawkesbury River into the sea. It appears that Milson never did farm this land and was able to instead convince the Governor Macquarie to change this to a larger land grant of 100 acres at Pennant Hills in the "Field of Mars" (see below). Milson was successfully farming before 24 August 1819 when he was paid £7 14s remuneration from Police Fund for damages done him by Government cattle.[49]

On 5 June 1820 an unsigned Memorial was written for James Milson to Governor Maquarie requesting further land.[6] (Milson did not write this memorial himself.[nb 2]) This memorial states that James Milson came to the Colony with the family of Mr Robert Campbell, and Robert Campbell also wrote and signed a recommendation for James Milson to receive "favourable consideration" for his request on the bottom of the Memorial. The Memorial states that James Milson was residing on and farming a 100-acre grant that he had previously received from Governor Macquarie ("your Excellency was pleased to extend") at Pennant Hills. Of this 100 acres he had 20 acres under cultivation and an additional 10 acres ready for cultivation. He also had 40 head of Horned Cattle "and very little pasturage lands to graze them upon" and this was the basis of his request for a further land grant.[6] As a result of this Memorial James Milson was granted a second 100 acres at Pennant Hills.

Sketch map[50] first published in 1955 in the book "The Life and Times of James Milson"[21] showing approximate location in the vicinity of the modern Jeffrey Street of "Milson's residence" in the 1820s which included his orchard and dairy. Also shows approximate location of the residence of Milson's son-in-law William Shairp[50] who married Milson's daughter Sophia in 1827.[51] The perforated line marks the approximate extent of the 120 acres (48ha) leased by Milson from Robert Campbell in the 1820s. Above the perforated line was the adjoining 50 acres (20ha) that was granted to Milson in August 1824.[19] Milson's residence was burnt down in the bushfires of November 1826. In 1831 Milson built a new residence overlooked Hulk Bay (now known as Lavender Bay)[4][13] located above the perforated line on his 50-acre (20 ha) grant.

In 1821 (the year ended 30 June 1822)[nb 3][22] Milson began to lease 120 acres (48ha) of land from Robert Campbell being the headland that includes Kirribilli and Milsons Points. There is a note held by the North Sydney Historical Society that states that Milson at first thought this land to be "nothing but rocks and stones, not enough soil to grow grass to feed stock."[7] This does not agree with Milson's desire to lease the land from Campbell, or his attempting to establish a dairy and orchard there, something that he was able to do successfully. The headland was indeed partly rocky but also contained areas of useful farm land. The rockiness was also useful in providing building materials, and from a quarry on Careening Bay a business of supplying sandstone ballast to shipping.[16] Warne's variation of this story is that Milson found the land to be "rocky and uncompromising but he was assured that the soil was good for farming and grazing, and he was provided two convicts to assist with the clearing".[1] This does not agree with Milson's experience as a man who had already been farming in the Colony for 15 years, or, in his own words, that Milson had been assigned convict servants from about 1810.[5]

Milson initially leased this 120 acres of land for 7 years which extended to 30 June 1828[nb 4] for a rent of £10 per annum "as a matter of favour" from Campbell. A lease agreement was signed by both parties with each taking a copy. The lease was then extended in a memorandum between the parties for a further period of 3 years to 30 June 1831 on the same terms. Non-payment of the rent on this lease between 1828 and 1831 became the basis of a court action in August 1831. By the time that Milson had stopped making rent payments on the lease, however, both parties had accidentally lost their copies of the original lease agreement, and Campbell had also accidentally lost his title deeds to the land.[16] Once the court case was concluded with Milson being ordered to pay the rental arrears as damages, Milson continued to lease land from Robert Campbell until Campbell's death in 1846, and then from subsequent owners. A map from the 1840s[17] show that Milson was still then leasing a smaller part of the 120 acres.

It is on part of the 120 acres (48ha) that Milson began to lease from Robert Campbell in 1821 that Milson built his dairy and his orchard and also grew vegetables in the area of the modern day Jeffrey Street. It is also on the small portion of the leased 120 acres where Milson established his dairy, orchard and vegetable gardens that Milson built his first home in the area, and another dwelling called "The Milk House" which became "a well known resort of Sunday-goers"[36] from Sydney. It was from the 120 acres of leased land that Milson built a good business supplying ships in Sydney Harbour with fresh fruit and vegetables, milk and water, as well as ballast from a quarry near Careening Cove.

There is no way of knowing exactly when in the early 1820s Milson and his family started to reside on the leased 120 acres. In the 1822 muster of New South Wales, however, he is shown as a resident of the District of Sydney rather than the District of Parramatta showing that the move probably had been made before then. Then in at least the period 22 August 1823 to 1 November 1825 Milson and his wife lived at least part-time at Government House as they were employed there, with James acting as a Steward and Keeper of Government House.[26][27][28][29]

In August 1824 Milson received from Governor Sir Thomas Brisbane a land grant of 50 acres (20ha) further up the headland and adjoining the 120 acres that Milson leased from Robert Campbell.[16][17][19] (Elizabeth Warne incorrectly states that this 50 acres was received not as a land grant but as a promissary note.[1]) This land grant gave Milson additional land on which to graze his dairy herd. This land grant also allowed Milson to be shown as a landholder in the District of Sydney in the 1825 muster of New South Wales rather than a resident as in the earlier 1822 muster. As Milson owned this 50 acres rather than leasing it, it was on this 50 acres that he built his family homes of "Brisbane House" (1831)[4] and "Grantham". This land grant also made Milson not just one of the areas most prominent businessmen but also one of the area’s most prominent landholders.

Devastating bushfires occurred in November 1826, with "a house in the occupation of Milsom, a milkman on the North Shore" being burnt down on Saturday 25 November 1826.[52] Elizabeth Warne also correctly records that the bushfires destroyed what was the other dwelling on the property, the "Milk House",[36] but incorrectly calls it a dairy building.[13] The Australian Dictionary of Biography[2] reports that Milson lost in the fire the title deeds of his land at Pennant Hills (close to Castle Hill) and his 50-acre (20 ha) grant at "Hunter's Hill" (then the name for the area of North Sydney that includes today's suburb of Kirribilli and not to be confused with the today's modern day suburb of Hunters Hill) which adjoined[17] the 120 acres (48ha) that Milson leased from Robert Campbell where Milson's dairy and orchard stood. If he lost the title deeds to these lands he also lost the title deeds to his other landholdings including those at Wollombi. (Loss of these title deeds did not force Milson to buy "some 890 acres" of land including land at Wollombi as claimed by Elizabeth Warne.[1] Milson already owned this land prior to the fire, having, for example, purchased Wollombi in 1825.[53] Loss of his title deeds had no long term consequence on Milson and those lands owned prior to the bushfire were also included in his will of July 1829.[2] The subsequent 1831 court case between Campbell and Milson over Milson's non-payment of rent on the lease of 120 acres of land at "Hunter's Hill" discloses that Milson's copy of the lease document was accidentally lost,[16] probably in the same bushfire.

In 1827 Milson had built for his family a replacement cottage on the leased 120 acres that he called "Brisbane Cottage"[13] on or close to the site of his home that had been destroyed by the bushfires. According to notes held by the North Sydney Historical Society this cottage was built by Martin Regan, one of Milson's assigned convict servants who lived until he was 105.[7] This replacement cottage, by then being used as a worker's cottage, appears in a map of the 1840s.[17]

Afternoon tea on the upper lawns of Carabella in the 1890s (Mitchell Library SLNSW)

In 1827 Milson also built his daughter Sophia as a wedding present a cottage that he called "Carabella Cottage" on his 50 acres, and two years later her husband William Sharp built nearby a much larger home that he also called "Carabella" for £600 and that was situated at modern 34 McDougall St, Kirribilli.[9] Milson was also to build his own homes "Brisbane House" (1831)[4] and then "Grantham" on this land. The Dictionary of Sydney describes "Brisbane House" as "a stone house with two storeys facing Lavender Bay, then commonly called Hulk Bay, after the convict hulks moored nearby" and "Grantham" as "a large bungalow-style sandstone home on a larger plot of land (now occupied by the Greenway Housing Commission flats)."[13] In the November 1828 census of New South Wales Milson is recorded as owning 1600 acres of land that included this 50 acres on which he was to build his home.

Before September 1828 it was known to both Milton and Campbell that neither of them had retained a copy of the original lease agreement for Campbell's 120 acres at "Hunter's Hill", and that both of them had lost the title documents for their respective lands at "Hunter's Hill". Only copies of the memorandum still existed.

Milson then attempted to obtain ownership of the land that he knew was owned by Robert Campbell by surreptitious means. In September 1828 Milson wrote to the Surveyor-General and expressed surprise that the land on which his house stood had been "measured to the Honourable Robert Campbell whose claim has never been properly established." Milson also wrote to the Governor on 3 October 1828 in a letter which stated "I have also to inform your Excellency that during the absence of the Surveyor-General, who is in Argyllshire, Messrs Cordeaux and Finch tool it upon themselves to erase my name which stood in the chart for the land which I am now in possession of, and are endeavouring to trump up a claim in favour of the Honourable Robert Campbell for the said land." Milson received a reply on 13 March 1829 from the Colonial Secretary, Alexander Macleay, which stated "I am directed by His Excellency the Governor (Ralph Darling) to inform you that if you allude to the spot on which you have built you must be aware that you cannot obtain it as it is the property of Mr Robert Campbell, who states that he actually gave a lease of it to you, and that the land to which you are entitled" (the adjoining 50 acres) "is already measured and marked out." [7][20]

Milton also stopped paying his rent after having paid £4 2s 8d of the £10 rent for the year ended 30 June 1829. By the end of June 1831 Milton owed Campbell £25 17s 4d in rent (£5 17s 4d for the remainder of 1828/29 + £10 for 1829/30 + £10 for 1830/31). In June 1831 Campbell had served upon Milton a bill of arrears of rent, and had received a promise of payment from Milton that had not been fulfilled. On 12 August 1831 Campbell then began court action against Milton for the arrears of rent. As the original lease agreement no longer existed Campbell sued Milton under an action of assumpsit (or breach of promise to pay) for use and occupation of Campbell's land.[16]

During the court action of 1831 Milton never disputed Campbell's title to the 120 acres, or that a lease agreement had been in place. Indeed a copy of the memorandum that extended the original lease, the "second document", still existed. Milton also did not disagree with the evidence of Campbell's son "that a formal instrument had been executed by the parties, binding them, under their hands and seals, to certain performances of a contract for a specified term of years". Milton instead disputed knowledge of the boundary between Campbell's 120 acres and Milton's adjoining 50 acres (referred to as "very large portion of land") which he contended could not be proved without the title documents ("proof of title") under which Campbell held his land. Lack of knowledge of the boundary Milton contended caused him difficulties and for this reason he had resisted paying rent. Milton contended that not knowing where the boundary lay between the two plots of land meant that Milton did not know where the opposite boundary of his own 50 acres lay, left him open to a charge of trespass if he impounded cattle that wandered onto his land if the cattle were in fact on the land of his other neighbour, and left Milton without knowledge of how far to advance with improvements on his own property either in the direction towards Campbell's land, or on his opposite boundary. (That Milton was also missing the title deeds to his 50 acres was not drawn into his argument.) Milton also contended that he did not have the use of the 120 acres "sacred to the lease" as a man by the name of Cunningham was allowed to come onto the land and take away quantities of soil. Milton also contented that the action of assumpsit (or breach of promise to pay) for Milton's use and occupation of Campbell's land was not a lie, but that the proper course for Campbell to have pursued should have instead been an action for debt under the second document, the memorandum.[16]

The decision of the court was that even without registered title Campbell was the legal owner of the 120 acres, and that Milton was the permissive occupant.[11] The action for assumpsit (or breach of promise to pay) for Milton's use and occupation of Campbell's land was therefore proved. Milton was ordered to pay to Campbell damages of £25 17s 4d, the arrears in the rent.[16]

The Australian Wednesday 29 November 1826

...it is calculated that the loss of property by the fire is greater than ever known before in the Colony by a similar event. A house in the occupation of Milsom, a milkman on the North Shore, was burnt down on Saturday.[40]

A second newspaper report in the Sydney Gazette of the same date provides more information. At the time of the bushfire Milson was away from the property but his wife and children were at home. Mrs Milson sustained burns from the fire.

Sydney Gazette, Wednesday 29 November 1826

During the extensive and frightful conflagration that occurred in the woods on Saturday last, the house occupied by Mr. Milsom, an industrious settler, in Neutral Bay, at the North Shore, was consumed. Mr. M. was from home at the time, and his wife and five children were on the spot, destitute of the assistance of a man servant. The whole of the property was destroyed, and the inmates, especially Mrs. Milsom, with difficulty escaped with their lives, though Mrs. M. was much burnt. Never before was any thing equal to the devastation which the fire has effected; the grass, is destroyed for miles upon miles, and the trees are continually falling, to the danger of the traveller beneath, from the effects of being burnt at the roots.[40]

A third newspaper report gives even more information about the events of the bushfire of 25 November 1826 that destroyed Milson's buildings and livelihood. This was coincidentally the 12th birthday of Milson's son James Milson Jnr.[nb 5] The report ends with the chilling words "chilling Poverty appears to be their only prospect." Fortunately that was not to be the case.

The Monitor 8 December 1826

DOMESTIC INTELLENCE

It is our painful task to record melancholy instance of the mutability of human affairs. There dwelt upon the North Shore a reputable family named Melsham (sic), the heads of whom had long held confidential posts in the households of Governors Macquarie and Brisbane; having acquired an easy competency, they had retired to this sequestered spot to enjoy the fruits of their labour, a comfortable neatly furnished dwelling; a garden, cattle and a well known resort of Sunday-goers, known as "The Milk House," which produced a considerable weekly rental, constituted their possessions. Melsham (sic) was absent, and his wife and daughter saw with fearful solicitude the distant smoke rising o'er the hill; towards the set of sun the blazing heath presented to their view an appalling prospect – two male domestics then on the premises made active endeavours to cut off the communication of the flames, by clearing a space as ample as time would admit of, to check its destructive progress; but the attempt was vainly made. The impelling breeze wafted ignited masses through the air, and the only resource now left, was to remove the most valuable and necessary portables the house contained. Apparel, beds, &c. were hastily conveyed to a distance, but the unfortunate owners were compelled to witness the demolition of their peaceful habitation – the small remaining hope of saving the residue of their property was not left them long. The destructive element made rapid progress towards the depository of their moveables and quickly was the wreck complete – of a watch, the wheels alone remained – an old Kangaroo dog, guarding, it is supposed, the last relics of his master's worldly goods, had the hair literally singed off him, and his legs left in a pitiable state. The fate of their Cattle is not yet known, whether destroyed in the conflagration or driven into the bush. By this unforeseen visitation of Providence, these unfortunate people are once more thrown upon the world, their hopes destroyed, and in the decline of life chilling Poverty appears to be their only prospect.[36]

Note: It is known from other sources that both James Milson and his wife Elizabeth did act as stewards at Government House, Sydney, for Governor Brisbane prior to 1826. They did not act as stewards in the time of Governor Macquarie and that part of the above newspaper report is incorrect.

The area of Kirribilli ("Hunter's Hill") was settled by Europeans early in the history of the Colony of New South Wales. The first record of land being granted in this area of the North Shore was on 20 February 1794.[nb 6] This was for 30 acres (12 ha) on the North side of the Harbour of Port Jackson, opposite Sydney Cove for a quit rent of 1s per annum after 10 years to an expired convict, Samuel Lightfoot.[11][22][54][55] The North Sydney Historical Society states that the 30-acre grant extended from where Milsons Point Railway Station is now to Kurraba Point but this is impossible as it is an area of much greater than 30 acres and extends over to Neutral Bay which was never part of the land grant.[7] Revising their description, the original land grant extended from about the position of today's Milsons Point Railway Station across to Lavendar bay, and down to and including Milsons Point, that is the western side of the later 120-acre land grant. Lightfoot was a former convict, born in about 1763 and transported to Australia for seven years for stealing clothing. He arrived with the First Fleet in 1788 on Charlotte.[56]

In 1794 Thomas Muir, a Scottish constitutional reformer, was sentenced to transportation for sedition. He arrived in the Colony on the Surprise on 25 October 1794. Lightfoot sold his farm to Muir who also had a cottage on what is now Circular Quay. The farm that Muir began to establish on the 30 acres he named, after his father’s home in Scotland, "Huntershill" (not to be confused with the modern day suburb of "Hunters Hill" further up the harbour). Muir is thought to have built a hut marked on an old map,[7] and therefore is thought to have been the first European resident on the North Shore. Thomas Muir escaped from the colony in February 1796 aboard an American brig, the Otter and died in France two years later.[7][11][22]

The next record of 26 April 1800 is that the 30 acres that had been purchased by Robert Ryan.[57] (Some references incorrectly state that Ryan was granted the 30 acres.[22]) Ryan had worked in Norfolk Island, both as a soldier and also a settler. It is not known how the ownership of the land passed from Muir to Ryan, or whether there were other unknown intermediate owners.

On 26 April 1800 the Colonial Secretary recorded that the 30-acre land grant to Lightfoot was cancelled.[57] The 30 acres had been purchased by Robert Ryan and was being cancelled to incorporate it with an additional grant of 90 acres (36ha) into a total grant of 120 acres (48ha) On the North side of the Harbour, opposite Sydney Cove for a quit rent of 2s per annum after 5 years. The 90 acres (he already owned the 30 acres) was being given to Ryan for his services in the Royal Marines and the NSW Corps. The corresponding entry in the Register of Land Grants states Cancelled, and a New Grant given to Robert Ryan for 90 acres in addition to this Allotment, by Governor Hunter. See the third Register, Folio 37.[11][22][55][58] The entry against the list of all grants and leases of land registered in the Colonial Secretary's Office for Robert Ryan's 120 acres says 90 acres of this grant is given towards the complement Ryan is entitled to of 160 for his services to the Marines & NSW Corps; the other 30 is a Grant of Samuel Lightfoot's which was purchased by the present proprietor & is now cancelled in the first Register folio 78. Robert Ryan therefore has yet 70 acres of land to receive.[57](160-90=70)

This 120-acre grant to Ryan included almost all of the Kirribilli headland including both Kirribilli Point and Milsons Point.

Around 1806 Ryan, who knew nothing about farming,[7] sold the property to Robert Campbell, a wealthy Sydney merchant.[22] Campbell built Australia’s first shipbuilding yards there in 1807, at the site that is now occupied by the Royal Sydney Yacht Squadron, Kirribilli.

The uninhabited 120 acres at Kirribilli was also used briefly for quarantine purposes in 1814 for the people who had arrived on the convict ship Surry.

In 1814 the Surry was carrying a "cargo" of 200 male convicts. Passengers on board were 25 men of the 46th Regiment. During the voyage out from England malignant fever (typhoid fever) raged on board and a total of 42 men died before the ship anchored in Port Jackson on 27 July 1814. Of these 42[42] men: 36 were convicts (listed with their names and dates of death in the Sydney Gazette of 10 September 1814[59]), 2 were of the ship's crew, 2 were soldiers from the 46th Regiment, 1 was the 1st (Chief) Mate, and shortly before the ship anchored the Master (Captain) of the ship also died.[41] (36+2+2+1+1=42).

Once the Governor became aware of the situation on board Surry he ordered that the ship be anchored near the uninhabited North Shore and be placed into quarantine. This quarantine was also placed on both the ship and the part of the North Shore off which the ship anchored to allow those on the ship onto land.

On Wednesday (27 July 1814) arrived the ship Broxbornebury...

Same day arrived the ship Surry, Captain PATERSON, who has since unfortunately fell a victim to a fever that had for some time raged with excessive fury on board that ship, and which has also proved fatal to the chief officer, two soldiers, belonging to a detachment of 25 men, of the 46th Regiment, two of the ship's company also, and 38 (sic) male prisoners, of whom she had originally 200 on board.

By the Surry has arrived Brevet Major Stewart, of the 46th Regiment.

The Broxbornebury fell in with the Surry off Shoal Haven; & on speaking her, learnt that from the relaxed state of the crew, and illness of the surviving officers, her safe conduct into this Port was despaired of, unless assisted from the other ship with some person capable of navigating her in; for which service a seaman capable of the task generously volunteered his service, and brought her in. - As soon as the melancholy report was communicated to the GOVERNOR in CHIEF by the Naval Officer, who had in the meantime, prohibited any communication with the vessel from any shore or ships' boats, HIS EXCELLENCY was pleased to confirm the interdiction until the nature of the prevailing malady should be ascertained, in the best manner that the circumstances of the case would admit, by the Principal Surgeon and the other Gentleman of the Medical Department; whose report, after being repeatedly alongside, confirmed the apprehension already entertained of the courageous nature of the distemper; and His Excellency was in consequence pleased to issue his instructions that she should be brought up at a convenient anchorage near the North Shore, where the people might be landed, and remain until the danger of their nearer approach should disappear; the necessary arrangements for which salutary precaution are stated in the General Orders of this day. The benefit of a free circulation of air onshore, and the exercise which the still suffering patients may become progressively capable of enjoying in this salubrious climate, to which the present season is perhaps far from being unfavourable, will, we hope most fervently, very shortly put an end to the pestilential terrors and render the restraint no longer necessary.

— "Ship News", Sydney Gazette, Saturday 30 July 1814[41]

The Government Orders about the Quarantine were clear that no one was to go near the persons who had arrived on Surry. A guard was to be placed on board the ship, another guard on the land, and severe punishment was promised for anyone who broke the quarantine.

Sydney Gazette, Saturday 30 July 1814

GOVERNMENT AND GENERAL ORDERS.

Head Quarters, Government House, Sydney, Saturday 30th July, 1814

The Male Convict Transport Ship, Surry. Which arrived in this Harbour from England on the 28th (sic) Instant, having brought a malignant Fever of a very infectious Nature, of which the Master (Captain), first Mate, and forty other Men (=42) have died during the Voyage, previous to the Arrival of the Ship in this Port; HIS EXCELLENCY the GOVERNOR had deemed expedient to use every possible Precaution to prevent the Danger of the Contagion extending from her to the Population of the Colony; and with this View he has given Orders to institute the most rigid Quarantine Restrictions in respect of the Ship herself, and all Persons on board of her, until such Time as the Fever is entirely subsided, and the People now infected are recovered.

It is therefore the GOVERNOR’S most positive Orders, that no Person whatsoever (the Medical Quarantine Officers and their Attendants excepted), shall have any Intercourse or Communication of any sort with the said Ship or the Persons now on board her, until such Time as she is relieved from Quarantine, which will be announced in Public Orders; and the GOVERNOR further directs and commands, that no Person shall visit, or have any Intercourse what ever with the Military Detachment, Sailors, ad Convicts, who are about to be landed from the said Ship on the North Shore of Port Jackson; where they are to remain encamped under strict Quarantine Regulations till further Orders. – There will be a Guard on board the Ship Surry, and also on the North Shore; to enforce these Orders; and any Person detected in attempting to act in Disobedience of them will be confined, and most severely punished.

By Command of His Excellency The Governor,

J.T.Campbell, Secretary.[42]

Quarantine restrictions were lifted for the ship on 13 August 1814, but the restrictions on the camp lasted longer.

GOVERNMENT NOTICE

SECTRETARY'S OFFICE, SYDNEY

Saturday, 13th August, 1814

It being duly notified to HIS EXCELLENCY the GOVERNOR, that the Disease on board the Male Convict Ship, Surry, which had rendered it necessary to put the Vessel under strict Quarantine on her Arrival in this Port, has now happily terminated, and the Danger of Infection from the said Ship is entirely removed:--This is therefore to give Notice that his EXCELLENCY is pleased to relieve said Ship from any further Continuence of those Quarantine Restrictions: but as the Disease is not altogether ceased in the encampment on the North Shore, the Quarantine Restrictions in Regard to that Place, and the Persons there, shall continue in full Force.

By Command of His Excellency,

The Governor,

J.T.Campbell, Secretary[60]

The uninhabited land on the North Shore off which Surry anchored, and on which the persons who had arrived on the ship were allowed to land and set up camp during the time of their Quarantine, was the 120-acre headland owned by Campbell that included Milsons Point and Kirribilli Point. Thus this headland was the first site in Australia to be used for quarantine purposes. This is known because three typhoid victims from Surry were buried there with their graves being in the area that later became Milson's orchard. These graves are stated to be the site of the first burials on the North Shore.[7][61] They are shown on MAP 3 in this article, a part of the 1840s map of the area.[17] The notation on the map says "Spot where three of the Surry's crew are interred". One of those buried is known to have been the ship's surgeon who attended the typhoid victims. In 1925-26 when homes were being demolished for the construction of the Sydney Harbour Bridge, the gravestones were found being used as hearthstones in cottages in what is now Bradfield Park (located approximately 50 metres west of the location of the graves shown on the early map), and included the gravestone of the surgeon.[7][62]

The 42 deaths before the ship anchored, plus the 3 graves brings the death toll to 45 (assuming that the 3 graves were all for deaths that occurred after the ship anchored). Bateson, however, states that there were a total of 51 deaths before the quarantine was lifted and lists the additional 9 deaths as the 2nd Mate, the boatswain, an additional 4 seaman, an additional 2 soldiers, and the surgeon.[63]

Thomas Raine was a junior officer on board the Surry. The epidemic of typhus left him the only surviving officer. He subsequently commanded her for the next three voyages (1816, 1819, 1823).[64]

Raine's grandson Tom Raine founded Raine and Horne, an Australian real estate franchise in 1883. There is a memorial to Raine slightly to the west of the Jeffrey Street Wharf.

The family tradition is that Milson lived on this land from the time of his marriage in 1810, and that Milson gave permission for the victims from Surry to be buried there in 1814.[23] That this piece of land was used for a strictly enforced place of quarantine is proof, however, that the 120 acres was uninhabited in 1814, that James Milson did not live there at that time, and that the graves were already in place before Milson moved there and started to build his orchard.

After the death of Robert Campbell in 1846 his lands first passed into the hands of his Estate, and then changed ownership under the terms of his will. It is by Campbell's will dated 11 October 18?? (unreadable) that Campbell's 120-acre property in Kirribilli was broken up into areas that can be readily compared with modern maps.

Campbell left a complex will. Eventually each of the sons received one-sixth of the estate while both daughters' shares passed on to the Jeffreys family by about 1880. The west side of Jeffreys Street was left to George Campbell, the youngest son. The east side of Jeffreys Street was left to the elder sons, John and Robert Campbell. Arthur Jeffreys was left the block of land immediately to the north of Jeffreys Street, on the northern side of Fitzroy Street.[20]

Among Campbell's landholdings bequeathed to his children was a small bequest to his daughter Sarah Campbell, the wife of Arthur Frederick Jeffreys. By a deed of partition dated 15 April 1848 and conveyance of 28 February 1854, Jeffreys received a small portion of the 120 acres being the area approximately bounded by modern Willoughby, Carabella, Fitzroy and Broughton Streets (including Burton Street),[18] an area of land that is immediately north of where Milson's dairy and orchard once stood.

Arthur Jeffreys subsequently disposed of various portions of his holding. In 1873, which was also after the death of James Milson, Jefferys sold 2 roods and 6 perches (.2 ha) to joint purchasers Neil Stewart of Parramatta and Henry Hocke Bligh of North Shore. This is the area of the modern Kirribilli Neighbourhood Centre [18] at 16 Fitzroy Street.

At this time Sydney was still a very small colony and the two new owners of this 2 rods and 6 perches of land were connected to Milson by marriage. Stewart's sister had been the second wife of Milson's eldest son, James Milson junior, and Bligh had married Elizabeth Milson Shair, Milson's grand-daughter.[18]

MAP 1: Earliest detailed map of Kirribilli Point and Milsons Point: an 1840s subdivision map for the Estate of Robert Campbell (1769–1846).[17]

MAP 2: Modern map of Kirribilli Point superimposed on top of 1840s map of the same area (superimposed on top of Map 2). Distortion in original 1840s map can be clearly seen. Marked on the map in green is the location of today' s Jeffrey Street; in yellow are the streets in the area of James Milson's Orchard on the 1840s map; in red (upper) is the location on the 1840s map of the large building shown near the milking bails; in red (lower) is the location on the 1840s map of the worker's cottage built within James Milson's orchard which can be seen to be located on modern day Jeffrey Street; in pink is the location on the 1840s map of the boundary of James Milson's orchard; and in pale blue is the approximate location of heritage listed Bratton.

Lavender Bay in the 1880s as photographed by Bernard Otto Hotermann from the western side of the bay towards Milsons Point. (Mitchell Library SLNSW)

MAP 3: Cropped detailed map of Jeffrey Street area of Kirribilli. Cropped from the 1840s subdivision map for the Estate of Robert Campbell (1769–1846).[17]

MAP 4: Map is from the 1850s but refers to earlier land grants. Caption reads "Early map published in the North Shore Times 8 May 1963 showing the boundary of the Municipality of St Leonards East, proclaimed 1860." Added to the original map are the words "Lavender Bay" which used to be called Hulk Bay, and "Milsons Point". Colours have also been added. Highlighted in yellow is the original 120-acre grant to Robert Ryan in 1800 that was purchased around 1806 by Robert Campbell; in pale blue is the 50-acre grant to James Milson in August 1824; in green is the approximate position that was marked on the map for the orchard that James Milson was still leasing from Robert Campbell in the 1840s (in the 1820s he leased the whole 120 acres); and in pink is the approximate position that was marked on the map for the farm of F.J. Hilly that was leased from Robert Campbell in the 1840s. The boundary of the Municipality of East St Leonards is marked in red.

The North Sydney Historical Society mentions an old map on which a hut is marked[7] but provides no other details.

A road survey map of 1822 identifies a "Point Kiriabilli" with no indications that the area was settled.[61]

The earliest detailed map of the area dates from the 1840s and is held by the National Library of Australia. It was a plan for sub-division drawn up for the Estate of Robert Campbell (1769–1846), the owner of the land. The map shows settlement in the area of Jeffrey Street and Milsons Point as well as what is now known as Kirribilli House and Admiralty House at Kirribilli Point. The other parts of the map have streets and property boundaries shown for the subdivision but are otherwise largely blank.

The map shows the extent of the 120 acres (48ha), owned by the Estate of Robert Campbell, which James Milson was leasing from Robert Campbell in the 1820s, and the subsequently smaller area that Milson was leasing in the 1840s where just his orchard, dairy and a worker's cottage were situated. The worker's cottage had been his second home in the area, "Brisbane Cottage".[13] It is believed to near the site of this cottage that Milson had built his first home in the area that was destroyed in the devastating bushfires of November 1826.

Adjoining the 120 acres (48ha) owned by the Estate of Robert Campbell the map also shows the location further up the point of the 50-acre (20 ha) grant of land made by Governor Brisbane to Milson in August 1824. When compared with modern maps of the area, the 1840s map shows that the boundary between Campbell's 120 acres and Milson's 50 acres went across the peninsula in a straight line, and that modern day Willoughby Street forms part of that straight line.

It was on this adjoining 50 acres (20ha) owned by Milson that Milson grazed his dairy cattle. It was also on this adjoining 50 acres (20ha) owned by Milson that Milson had resided since 1831 when he built "Brisbane House" as the family home. The house was named after Sir Thomas Brisbane, Governor of NSW from 1821 to 1825. It was a two storey stone house situated approximately at the block enclosed by today's Arthur, Middlemiss and Lavender Streets, Lavender Bay. The home faced Lavender Bay, then commonly called Hulk Bay, after the convict hulks moored nearby. In addition Milson later built on this 50 acres (20ha) a large bungalow-style sandstone home situated at Greenway Drive, Milsons Point near where the Greenway Housing Commission Flats are today. This home was called "Grantham" after James Milson's place of birth. Both these homes were demolished in 1925-26 to make way for the building of the Sydney Harbour Bridge.[4][13]

The cropped detail map shows that Milson had an orchard, dairy, beehives and a (worker's) cottage on leased land in the vicinity of Jeffrey Street. In the orchard were the 1814 graves of three men from the "Surry", vegetable beds and a gardener's hut. The dairy was in a barn and near the dairy was a well, milking bails, and a calf pen. The cottage had a separate kitchen and near the cottage were sheds, a stable, a store, the bee-hives, and a men's slab hut. The map also shows the tank on the foreshore below the orchard that Milson built in 1832 (according to the Australian Dictionary of Biography) to supply water to shipping.[17] According to one contemporary observer of the times:

Mr Milson, North Shore, has cut a cistern in the solid rock capable of containing 100 tons of water [which is] supplied from an excellent spring constructed so as to fill, by means of a leather hose conductor, ship's boats along the beach where the water is of sufficient depth to float a ship of the line.[65]

Other features of the cropped detail map in the vicinity of Jeffrey Street are as follows:

• The shape of the shoreline has not changed significantly since 1840, the variation is due to the construction of ferry landings in the vicinity of the Jeffrey Street Wharf over the past 100 years and also the construction of the Sydney Harbour Bridge in the 1930s.
• The Sydney Harbour Bridge is now located at the base (south) end of the point.
• The large building shown at the top of the map near the "Milking Bails" and a "Calf Pen" is marked as a "Barn". It is close to Bratton, a Victorian Italianate style heritage listed building at 36 Pitt Street Kirribilli.[66]
• The small stream marked at the south east corner of the "Orchard occupied by J. Milson" is most probably the site of a small timber decked simple steel bridge in what is now called "Captain Henry Waterhouse Reserve".
• The map identifies the 1814 graves for three typhoid victims from the ship Surry. These graves were within the area that Milson leased from Campbell for his orchard.
• Many of the streets and some property boundaries can be readily compared with modern maps.

A map from the 1850s for the then proposed Municipality of East St Leonards (which was proclaimed in 1860) shows boundaries of original grants. It shows the extent of the 50 acres that was granted to James Milson in August 1824 which has been highlighted in pale blue. When compared to modern maps it shows that the 50-acre grant extended from Berry Street in the North, Walker Street in the West, abutted Careening Cove and other grants in the East for which no modern street marks the boundary, and adjoined Campbell's 120 acres in the south at Willoughby Street.

Sydney Monitor, 5/10/1831:

SUPREME COURT - CIVIL SIDE

SEPTEMBER 30 - Before Mr. Justice DOWLING, and Messrs. McLaren and Ross, J, P.'s, Assessors.

Campbell v Milsom - This was an action of assumpsit (breach of a promise to pay), to recover the sum of £25 17 4d, for rent due from the defendant for the use and occupation of a certain farm situate on the North Shore, leased by the plaintiff to defendant for a term of years. It appeared in evidence that the defendant leased a farm of 120 acres at the North Shore, from the plaintiff his former employer, as a matter of favour from the plaintiff, at an under rent of £10 per annum, for a term of seven years originally, and which was subsequently extended three years for the purpose of growing vegetables, &c. For the fulfillment of the contract on both sides, an Instrument was signed by both parties, each taking a copy, but which instruments was by accident lost by both parties. That the defendant had punctually paid his rent up to the year ending June 1828, and also the sum of £4 2s 8d towards the rent of the year 1829, at which time he stopped payment, without assigning any reason for so doing; in consequence of which a servant of the plaintiff's waited on the defendant in June last, presented him with a bill for the arrears of rent, and received a promise of payment from him, but which promise he had never fulfilled, which was the occasion of the present action.

For the defense, Mr. Wentworth, without calling witnesses, in his address to the Court, stated that the defendant would not have resisted the payment of the rent if he could have discovered for what he was paying such, having frequently applied to Mr Campbell for the boundaries of his farm, but without being able to obtain them. In consequence of which, had the defendant been disposed to impound any cattle, he could not have done so without making himself liable to an action at law for a trespass. Another important fact was, that the defendant carried on a trade in supplying the shipping in the harbour with ballast, by the consent of the plaintiff; and yet although the farm ought to have been held sacred to the lessee, and which in fact the lessor was bound to secure to his tenant, a person of the name of Cunningham was in the habit of taking away quantities of soil for ballast, under the sanction of an order from the Colonial Secretary. In the absence of any proof of the title under which the plaintiff held the land, the defendant who was granted a very large portion of land from Sir Thomas Brisbane, had taken up a part of that grant adjoining the farm in question, but did not know how far he might have advanced for want of the proper boundary, and which the plaintiff also appears not to know. Mr. Wentworth contended, that by the evidence of the plaintiff’s son, it appeared that a formal instrument had been executed by the parties, binding them, under their hands and seals, to certain performances of a contract for a specified term of years, and that the present action of assumpsit for use and occupation, could not lie, but that an action of debt would have been the proper cause to pursue.

The learned Judge over-ruled the objection taken by Mr. Wentworth, as he was advised, that the second document was not formally drawn, but was merely a memorandum between the parties, and put the case to the Assessors on the merits, who immediately returned a verdict for plaintiff. Damages - £25 17s 4d.[16]