This post contains some affiliate links
Friends,
Locals call it America’s Most Haunted House, but the Whaley House legacy is more than a simple family home in Old Town San Diego. Before Thomas Whaley laid the foundation stones, “Yankee Jim” Robinson swung from a gallows on that very ground. The Whaleys moved in anyway.
Soon after, young Thomas Jr.’s bedroom fell silent to scarlet fever. Daughter Violet took her own life. Between bankruptcy and a fire that nearly consumed everything, visitors now whisper of footsteps in empty hallways and phantom figures glimpsed through doorways—stories that cling to the museum walls to this day.
Yankee Jim Robinson
In the summer of 1852, a tall, fair-haired Canadian known as Yankee Jim Robinson set foot in San Diego. The origin of his nickname remains unclear—some accounts suggest he earned it during his naval service before arriving in California in 1842, while others claim he acquired it later while searching for gold up north.
Yankee Jim’s motives for settling in San Diego remain contested. Some historians paint him as an affable fellow who, alongside two companions, sought new prospects in the growing coastal town. Others view his arrival more cynically—as a calculated stop on a criminal expedition that would culminate in a comfortable Mexican hideaway.
Public opinion of Yankee Jim would go from bad to worse when he attempted to steal a pilot boat docked in the San Diego Bay. Pursued by townsmen, Yankee Jim escaped by stealing a rowboat and rowing himself across the bay to Point Loma. He was captured several hours later after he stopped at a ranch to ask for food and water.
Hasty Trial
The county authorities wasted no time after the capture, bringing Yankee Jim and his companions to trial within days. Yankee Jim initially dismissed the proceedings as an elaborate prank meant to frighten him into contrition. How could he take it seriously? The very men who had pursued him across the bay now sat in the jury box, and Judge Benjamin Hayes swayed visibly on the bench, obviously drunk during the whole proceedings.
Prosecutor James W. Robinson (no relation) opened the trial by accusing Yankee Jim of plotting to commandeer San Diego’s sole vessel for acts of piracy. Throughout the proceedings, Yankee Jim’s laughter disrupted the courtroom multiple times, requiring repeated admonishment. His amusement faded when, following brief deliberation, the jury delivered their verdict: death. Judge Hayes concurred, sentencing Yankee Jim to hang by the neck the following day.
On 18 August, at the future site of the Whaley House, Yankee Jim’s laughter finally ceased. The sight of the hemp noose erased any lingering belief that this was all some elaborate prank. Standing at six-foot-three, the Canadian towered over his executioners, a height that would prove fatal in the most gruesome way—the hastily constructed gallows lacked sufficient drop. For thirty agonizing minutes, his toes brushing the wagon below, Yankee Jim dangled between life and death, his breath coming in ragged gasps until the final one escaped.
Building on Bloody Ground
Thomas Whaley broke ground on his ambitious residence on 6 May 1856, boasting it would surpass any dwelling within a 150-mile radius in beauty, comfort, and convenience. He personally designed the Greek Revival structure, a two-story edifice constructed from bricks manufactured at his own brickyard on Conde Street.
When finished, the home—adorned with mahogany and rosewood furnishings, elegant Brussels carpets, and representing an investment exceeding $10,000—earned widespread acclaim as Southern California’s premier residence, unprecedented in its refinement.
But all that glitters is not gold.
Tragedy Begins
Tragedy struck the Whaleys in the winter of 1858, when scarlet fever claimed their infant son, Tommy, before he reached his second birthday. Though summer brought new life with the birth of their daughter Anna Amelia within the brick walls of their home, autumn delivered yet another blow—flames, deliberately set by an unknown hand, reduced Mr. Whaley’s profitable storefront to ashes.
Grief-stricken by Tommy’s death and financially devastated by the fire, the Whaleys accepted an invitation from friends to rebuild their lives in San Francisco. Their house in Old Town remained unsold, prompting Whaley to entrust its care to his associate Squire Ensworth, who took up residence and supplemented his income by letting rooms to boarders.
Alaska Bound
The Whaley family expanded with the arrival of three more children in San Francisco: George Hay Ringgold, Violet Eloise (known as Vi), and Corinne Lillian. While serving briefly as a U.S. Army Commissary Storekeeper, Whaley’s duties took him to Sitka in Alaska Territory.
There, he oversaw three government supply transports just before the American acquisition of 18 October 1867. Whaley participated in the ceremonial raising of the American flag on Japonski Island across from Sitka, and his standing in the community led to his unanimous election as a councilman.
Whaley journeyed back to San Diego, determined to persuade his family to abandon San Francisco and once again stake their future on the brick house that embodied his ambitions. His wife would not be moved.
The Show Must Go On
Desperate to find someone who would help with the financial burden of two households, Whaley crossed paths with Thomas Tanner, a showman who led the renowned Tanner Troupe of circus and vaudeville performers.
By October 1868, the second floor of Whaley’s building had become home to the Tanners, with what had once been the family’s parlor and dining rooms on the western side now serving as San Diego’s first commercial theater.
Promising weekly entertainment for the community, the Tanner Troupe Theater raised its curtains for the first time on 2 December. Patrons paid 75 cents for reserved seating or 50 cents for general admission, with children’s tickets available at half price. Following the premiere, the San Diego Union published the following review:
THE TANNER TROUPE. The performance of this troupe on last Wednesday evening, considering the circumstances, was very creditable. The house was filled to utmost capacity; which is a matter of congratulation to the manager; and all seemed pleased with this first attempt in this place, at least, at a theatrical performance. Notwithstanding the perfectly apparent indisposition of Mr. Tanner, the bronchial affliction of Miss Soledad, the rawness of the novices, the defective musical arrangements, the want of capacity in the seating room, and the smallness of the stage, we may be pardoned for saying that our theater is a success. Owing to the continued indisposition of Mr. Tanner the performance which he announced for tonight is postponed until Wednesday evening next, after which the troupe will perform nightly. –The San Diego Union, December 5, 1868.
Returning Home
The earth beneath San Francisco shuddered violently on 21 October 1868, and Anna Whaley’s resolve to stay crumbled with it. By December, she had gathered the children and boarded the steamship Orizaba bound for San Diego.
The Tanner Troupe had barely established itself, their October opening still fresh, when tragedy struck. Merely a week after Anna’s return, Thomas Tanner, at fifty-six, took his final bow—found lifeless in his bed following an evening performance. With their leader gone, the troupe’s curtain fell for good in early 1869.
The Whaley family returned to the main two-story building in late 1869. Shortly thereafter, San Diego County officials transformed the old theater into meeting chambers for the Board of Supervisors. Meanwhile, the building found a new purpose as the county’s second courthouse.
Whaley increased profits by transforming his failing general store into a bar. Writing to Anna on 18 October 1870, Thomas explained,
“I am writing this in my Saloon and as the Court is in session, I am very busy, therefore you will excuse the shortness of this. I shall do very well keeping bar when the Court sits at other times, it will not pay to keep open, and as it now is I am open only from 9 to 5. I can take in from $20 to $30 per day, half of which is profit. Better than storekeeping.”
Tragedy Strikes Again
In 1885, the house witnessed tragedy when Thomas Whaley’s 22-year-old daughter Violet ended her life within its walls. She turned her father’s .32 caliber revolver on herself after enduring months of melancholy and social disgrace. The young woman had fallen prey to George T. Bertolacci.
Los Angeles, California • Sat, 22 August 1885 Page 4
On 13 February, Bertolacci sat at his desk and composed a letter to Violet, whom he had married just a month prior. He wrote the opening line: “When I married you, I meant to have been good.”
The pages that followed revealed the lies of his family history, acknowledged the existence of a daughter born out of wedlock, admitted to encounters with a woman of questionable profession who had depleted his finances, and offered the familiar refrain that alcohol, not character, was to blame for his failings.
When her sister died, Corinne Lillian was planning her wedding. The scandal that followed proved too much for her betrothed, who returned his ring and withdrew his promises.
The End of an Era
After burying Violet and Corinne, Lillian’s heartbreak, the Whaleys couldn’t bear to stay. They relocated to New Town, where Mr. Whaley constructed a modest single-story residence at 933 State Street. Meanwhile, their brick home in Old Town stood empty most seasons, hosting only temporary tenants who invariably departed before their leases expired, due to unexplained noises and occurrences.
After decades of neglect, the Whaley House in Old Town stood faded and crumbling by 1909. That year, Frank Whaley—the eldest son—returned to his childhood home, a weathered brick house, and began its painstaking revival. Living within its restored walls, he transformed the building into a living museum, hanging hand-painted signs that boasted of its historical significance.
Visitors who wandered through the former courtroom, now filled with carefully arranged artifacts, often lingered into the evening as Frank’s guitar melodies drifted through the rooms his father had built.
George and Lillian returned to the Whaley homestead in Old Town, leaving their State Street residence behind to serve as a rental property. The old house claimed Anna Whaley first, taking her at eighty-one on 24 February 1913. Her eldest, Frank, followed on 19 November 1914. George’s time came on Christmas Day, 1928.
Only Lillian remained, keeping company with the family home and filling notebooks with her recollections until 14 September 1953, when she too departed at the age of eighty-nine.
Hauntings at the Whaley House
Though Yankee Jim earned his place as the Whaley House’s first documented ghost, visitors have since encountered other unearthly residents. The distant cries of an infant pierce the silence without explanation, while a forlorn young woman materializes in the empty courtroom only to vanish moments later.
In the parlor especially, guests often find themselves seized by an inexplicable sadness, their skin prickling with the certainty that unseen eyes follow their every move.
During guided tours, flashlights inexplicably go dark in visitors’ hands, while the distinct sound of wooden joints straining under invisible weight emanates from vacant chairs. Guests with no prior medical conditions have experienced sudden vertigo and a creeping sense of dread that vanished the moment they stepped beyond the property line.
Final Thoughts
The Whaley House was a childhood sanctuary for me, a regular pilgrimage whenever my mother shepherded my sister and me through Old Town. She’d weave tales of her youth in the area, stories that shimmered with strange possibilities.
Have I encountered the spirits said to haunt those historic halls? I’ll keep that between myself and those weathered walls. But I can tell you this much—I’ve never questioned the legends that draw crowds of tourists to San Diego’s most notorious residence.
RIP Whaley Family.
- Father Thomas: Died in 1888
- Mother Anna: Died in 1913
- Corinne Lillian: Died in 1953
- Thomas Jr.: Died in 1858 of scarlet fever at 18 months
- Violet: Died by suicide at age 22 in 1885
- Francis: Died in 1914
Until next time, Keep Reading and Stay Caffeinated.
For those hungry to explore more, click below to find additional readings:
Ghostland: An American History in Haunted Places. Conjure the dead by focusing on questions of the living—how do we, the living, deal with stories about ghosts, and how do we inhabit and move through spaces that have been deemed, for whatever reason, haunted? Paying attention not only to the true facts behind a ghost story, but also to the ways in which those facts change—and why—Dickey paints a version of American history left out of the textbooks, one of things left undone, crimes left unsolved.
Food to Die For: Recipes and Stories from America’s Most Legendary Haunted Places. Whether you’re in the mood for Lizzie Borden’s meatloaf or want to serve up spooky prison stories along with sugar cookies from Alcatraz, Food to Die For is your guide to ghoulish gastronomy. One of America’s favorite ghost hunters, Amy Bruni, takes you to mysterious hotels, eerie ghost towns, and possessed pubs in this delightfully sinister collection of stories and recipes.
Subscribe below to stay up to date on myths, legends, mysteries, and the chaos of history.
If you’re looking for your next favorite read, I invite you to check out my book, The Raven Society. This spellbinding historical fantasy series takes us on a heart-pounding journey through forgotten legends and distorted history. Uncover the chilling secrets of mythology and confront the horrifying truths that transformed myths into monstrous realities. How far will you go to learn the truth?
The Writer and The Librarian (Book 1):
Signed copies at:
https://rlgeerrobbins.com/product/the-writer-and-the-librarian-the-raven-society-book-1/
Explore more blogs here:
Sources:
Paper Ghosts: The Ephemeral Legacy of the Thomas Whaley Family
#1 San Diego Haunted House | Whaley House Haunted Night Tour
lessonspioneerwhaleyfamily.pdf
Historic Resources Inventory.xls