Small islands are a good place, at least I think so, as long as you have a good boat with storage and accommodations.
Many marinas, moorings and secluded bays, even in the FL keys. For example, the Bahamas contain over 700+ islands, many private or uninhabited, only accessible by boat, the nearest is around 50 nm from FL.
I watched a series of vids of two FL fisherman, they sailed a small sailboat from FL to the Bahamas, checked in with customs, and went fishing at several different deserted islands, they didn't encounter anyone until a local fishing boat saw them, but didn't approach them. After the local fishing boat left, and was no longer visible they moved to another island saying they didn't want to take a chance of that fishing boat coming back at night to rob or kill them...piracy is still a real threat.
You're far enough away from large population centers, and can easily sail away. If a hurricane is coming, you can look for a "hurricane hole" or "snug harbor" - a sheltered place to ride out the storm. During hurricane season, probably a good idea to always know where the closest safe harbor is located.
FWIW, after posting about the USVI, I looked at property on the USVI again, and the crime stats are just not worth it; unfortunately.