Because of his fascination of the Hindu religion and India, he incorporated much of the elements in to his new home. Bricks and tiles were imported from India. He even
enlisted the help of 70 Indian workers from Madras of South India as skilled laborers for the construction of the mansion.
Unfortunate, he ran in to one major setting back. Many of the workers contracted the Spanish Flu and died in the early 1920s. A temple was built 1500 m from the castle
for the deity Mariamman. Some say it was to protect those who lived on the property. Others say Kellie had it built as a way to thank Mariamman for granting his wish to
have a son. However, the temple still stands and many continue to worship in it. The first elevator in Malaysia is located in Kellie's Castle. It travels from the roof down to
the underground tunnels. He also planned to build an indoor tennis court. The rooftop was reserved for a courtyard for parties. World War I slowed the process even more.
In the end, Kellie's Castle was never completed.
Smith took a short trip to Britain in 1926 supposedly with his daughter. It's unknown why he made a detour to Lisbon, Portugal (some believe it was to pick up a lift for his
new manor). In December of 1926, he contracted pneumonia and died at age of 56. Agnes later packed up and left Malaysia with her children back to Scotland. She sold
the castle to a British company called Harrisons and Crossfield. Anthony Kellie Smith was killed in World War II. Helen never returned to Kellie's Castle. The only thing left
of the first home is the covered walkway, an open courtyard and part of a crumbling wall. Kellie's Castle has been refurbished and appears as if it has never been touched.
It was even used as a setting in the 1999 film Anna and the King. A company manages the property as a tourist attraction now. Some believe it is haunted by the family it
was built for.
William's spirit has been seen pacing at night in the 2nd floor corridor. Helen wearing a white blouse and curly hair haunts her old bedroom. Phantom smells of incense
and spirits have been reported in the horse stables. Adding to its mystery, some believe the mansion possesses hidden rooms and secret underground tunnels.