Categories
Data Custody Decentralisation and Neutrality Privacy and Anonymity The Next Computer

My data backup strategy and tools, 2021

Here’s an overview of how I backup my data across drives and devices.

I was driven to post this because of the recently reported data loss experienced by several people around the world, caused by a malfunctioning, possibly hacked network storage device from Western Digital: “WD My Book NAS devices are being remotely wiped clean worldwide“.

Today, WD My Book Live and WD My Book Live DUO owners worldwide suddenly found that all of their files were mysteriously deleted, and they could no longer log into the device via a browser or an app.

When they attempted to log in via the Web dashboard, the device stated that they had an “Invalid password.”

“I have a WD My Book live connected to my home LAN and worked fine for years. I have just found that somehow all the data on it is gone today, while the directories seems there but empty.

The same device that Western Digital encouraged its customers to ‘Put Your Life On [It]’, lost people’s photos, music, documents, backups, probably more.

Ordinary people like you and me need a better plan for our life’s work and memories than entrusting it to a company and its specialised hardware and software. We need a plan we understand.

This is that plan.

Devices to backup

  • MacBook Pro 1TB SSD
  • iPhone 128GB
  • iPad 256GB
  • External 1TB HDD – archives, old pictures, home movies, other uncategorised data

Laptop, phone, tablet all used daily.

Current backup plan

MacBook Pro

  • Runs Catalina; full weekly disk backup on external 1TB Time Machine HDD.
    • Quarterly restore test on 2014 MacBook Air also running Catalina
  • Backup main document and multimedia folders weekly with rsync, run manually from iTerm2, to external 2TB HDD (redundancy for above). Example: sudo rsync -aP --delete /Users/rahulgaitonde/Documents/ /Volumes/Backups/BackupDocuments

External 1TB drive

WD Elements 1TB drive
  • Backup weekly with rsync, run manually from iTerm2 to external 2TB HDD: same disk as above

iPhone, iPad

2018 12.9″ iPad Pro 256GB and 2018 iPhone XR 128GB
  • iCloud Drive backup, continuous

Other data

  • Email: Gmail and Google Workplace; downloaded locally to Thunderbird on MacBook Pro as Mbox files (which is itself backed up as above)
  • Photos: synced from iPhone and iPad to iCloud; also synced weekly from iPhone to MacBook Pro Photos.app on MacBook Pro
  • Notes: Notes.app and plaintext files; both synced to iCloud
  • Contacts, Calendar, Reminder: synced to iCloud; exported monthly to MacBook Pro
  • Passwords and secure notes: synced to Bitwarden; vault exported monthly to MacBook Pro
  • RSS feeds: synced to Feedly; OPML exported monthly to Macbook Pro
  • Bookmarks: synced to Firefox; HTML exported monthly to Macbook Pro
  • Read Later queue: synced to Instapaper and Pocket; CSV exported monthly to MacBook Pro. Some articles saved locally in Markdown in iCloud Drive

So, here are my tasks:

  • Weekly
    • Run Photos.app to sync iCloud Photos locally to Macbook Pro (turn off storage optimisation) – 10 minutes
    • Backup MacBook Pro to Time Machine external HDD – three hours
    • run rsync on MacBook Pro drive and on external 1TB HDD. Destination for both is external 2TB HDD (distinct from Time Machine). 10 minutes. First run took a long time; subsequent runs take a fraction of the time that Time Machine backups take.
    • Total time: appx. 20 active minutes; 3 hours in background
  • Monthly
    • Export Contacts, Calendar, RSS OPML, Bookmarks, Password Vault, Read Later queue and store locally – 10 minutes
    • Weekly tasks for that week
    • Total time: appx. 10 active minutes + regular weekly backup time
  • Quarterly
    • Test restore on 2014 MacBook Air – about 10 active minutes + 2 hours in background
    • Weekly and monthly tasks
    • Total time: appx. 10 active minutes + 2 hours in background + regular monthly backup time
  • Automated:
    • Downloading mail locally happens throughout the day since Thunderbird is always open
    • iCloud Drive backups happen daily automatically since iPhone charges wirelessly overnight

As you can see, I don’t actually spend a lot of time backing up my data. I last suffered a catastrophic data loss in 2008, and I’m determined to not let that happen again, especially now that storage is cheap and fast, and cloud backups exist.

In the early days of this system, I was tempted to automate large parts of it. I could run an open-source Time Capsule using an unused Raspberry Pi and Netatalk. I could also connect the external 2TB drive and run rsync from my Mac to the remote Pi machine (rsync, or remote sync, was in fact built for this use case).

That way my Time Machine backups would run every hour, not weekly. I could also automate rsync to, say, daily by using MacOS’ cron, a scheduling utility that’s part of almost every unix-based system.

But that frequency of backup seems overkill for my data, especially given that the vast majority of my everyday data, the one that changes daily, is backed up to iCloud. Even if I were to lose data mid-month, between restoring from the latest Time Machine backup and then syncing to iCloud, I’d be able to recover most, if not all, of my data. So that means leaving a computer running, with my backup disks attached, that’s really doing useful work for a tiny fraction of the time. That also means extra wear on the very disks I’m using for backup.

In conclusion

My solution is a mix of cloud sync and manual backup.

The cloud portion – for frequently changing data – uses iCloud, which seems to be the most privacy-centric of all cloud services.

The manual portion – for redundancy and archived data – uses open source tools and doesn’t rely on either an always-on computer, specialised hardware or a connection to the Internet, unlike the Western Digital NAS this post began with.

Finally, the solution doesn’t take a lot of time to run, and can be restored from pretty quickly. The only vulnerability in this system is that all the devices and disks are in my house. If there’s a catastrophic event at my place, the data that’s backed up manually will be lost.

Categories
Uncategorized

Will It Be As Much Fun?

From critic Roger Ebert’s 1997 review of the science fiction movie Gattaca, released in the same year, whose plot involves the use of genetic engineering to create designer humans:

When parents can order “perfect” babies, will they? Would you take your chances on a throw of the genetic dice, or order up the make and model you wanted? How many people are prepared to buy a car at random from the universe of all available cars? That’s how many, I suspect, would opt to have natural children.

Everybody will live longer, look better and be healthier in the Gattacan world. But will it be as much fun? Will parents order children who are rebellious, ungainly, eccentric, creative, or a lot smarter than their parents are? There’s a concert pianist in “Gattaca” who has 12 fingers. Don’t you sometimes have the feeling you were born just in time?

Quoted in The Code Breaker: Jennifer Doudna, Gene Editing, and the Future of the Human Race by Walter Isaacson

Categories
Data Custody The Next Computer

iPhone home screen, June 2021

Note: my Home Screen in May didn’t change at all from April, so I didn’t post a monthly update.

This month, I added four icons for commonly used apps on my Home Screen, making place for them by using a smaller Fantastical widget:

The dock has also changed. I still use Drafts for quick note taking, but I have begun to use Apple Notes for everyday note and list management, somewhat inspired by an old tweet from the Twitter and Square cofounder Jack Dorsey:

I’m also trying out a large notes widget for a folder on the leftmost widgets-only screen. Let’s see if it’s truly useful:

Categories
Data Custody Decentralisation and Neutrality Discovery and Curation Products and Design The Dark Forest of the Internet

Preserving the web that matters to us

A quarter of the deep links in The New York Times’ articles are now “rotten”, or no longer accessible. The older the web page, the more likely it is that the articles it links to no longer exist. This chart makes it clear:

The internet is decentralised by design. That means no single entity decides whether a given article on the web is taken down.

But that also means that no single entity can ensure that that article can stay up. If the owner of the domain dies, forgets to renew, or simply chooses not to, it’s gone. The Internet archive can’t archive every single web page that ever existed.

That means it is up to each of us to preserve, privately, those parts of the web that matter to each of us.

I am personally a long-time user of both Instapaper and Pocket (from when they were personal projects of their creators), and have thousands of articles in each. Should either of these services shut down, I will be able to export my saved articles. For articles and web pages with more significant personal value, I also have a folder full of markdown-formatted versions of them. I ended up creating an iOS Siri Shortcut to automate this, which I use every day.

Other ways are to save the full text in Evernote, or OneNote, or Notion using their browser extensions, and they’ll be available to you as long as these services are active. You could also copy the web page, paste it in an email and mail it to yourself, creating a library within email. Which again is accessible – and searchable! – as long as you have access to that email address. There’s no perfect solution.

The important take-away here is that what makes the Internet resilient as a whole makes it fragile at a microscopic level. Saving bookmarks alone is no guarantee that you’ll be able to access something on the web later. You’ll need to save the page itself, and find a system for this that works for you.

Categories
Uncategorized

The ongoing neurological revolution

The neurologist Oliver Sacks, in a posthumously published piece, describes what he sees as the damage wrought by smartphones:

I have only to venture into the streets of my own neighborhood, the West Village, to see… by the thousand: younger people, for the most part, who have grown up in our social-media era, have no personal memory of how things were before, and no immunity to the seductions of digital life. What we are seeing—and bringing on ourselves—resembles a neurological catastrophe on a gigantic scale… I dare to hope that, despite everything, human life and its richness of cultures will survive, even on a ravaged earth.

I understand how the technology and electronics industry spends unimaginably large amounts of money and manpower to keep us in a state of perpetual distraction, a state in which they can leech data and serve ads throughout the day. We have examined this both on this site and on Reclaim Attention.

At the same time, I don’t think it’s a problem for people to spend their time in multiple online and ‘real-life’ spaces simultaneously. In fact, we are often different people in different spaces at the same time.

Dr. Sacks termed this a neurological catastrophe. I think this rapid rewiring of our brains is a neurological revolution. The young don’t retain facts, phone numbers, commitments because the internet and their devices do. And that’s ok. As is the fact that "a majority of the population is now glued almost without pause to phones or other devices—jabbering, texting, playing games, turning more and more to virtual reality of every sort."

It’s also why I think the high-level assumptions underlying the design of features like Apple’s Screen Time and its Android equivalent are fundamentally flawed: the amount of time spent on one’s devices is not inherently inversely correlated with mental health, and I suspect the younger you are the more obvious this is.

As I’ve written earlier, our online lives are an escape from the dreariness of our daily lives – even when in school. They’re safe spaces for marginalised people. They’re stages on which to express our talents, however well or poorly. They’re rabbit-holes down which we indulge our curiosities. They’re 24×7 telegraph and long-distance lines over which to sustain and deepen relationships with people no longer a few streets away.

I think we’re only now realising that globalisation is as true for human attention as it was for goods.

Categories
Life Design

Own-goals

When we obsess over our goals, we can easily sacrifice what makes those goals meaningful in the first place. 

The Surprising Science of Goal Setting (And Why You’re Probably Doing It Wrong)

It’s a good article, like a lot of Mark Manson’s work. Particularly whether our goals are aligned with our values.

That, of course, presupposes that we’re aware of our values in the first place. That’s a whole other exercise, and uses a different part of the brain than goal-setting does.

We don’t usually think about or acknowledge our values to ourselves. I think that’s because by the time we establish our own independent lives, we’ve already made several commitments: a degree, a city, a job, a house (often relative to the job), loans, maybe a spouse. Each of those comes with its constraints – in the case of the spouse, their own (often tacit) values.

I think we implicitly grok that our values, even if unacknowledged to our own selves, are already in conflict with many, most, of these commitments. That’s why our goals are, from day one, typically misaligned with our values.

Most of our twenties and some of our thirties are about realising this. The rest of our thirties and forties are us fashioning an ersatz compromise between who we are and who we really are. And that’s probably why people really only begin to chill after that.

Spending over half our lives in this muddle is both uniquely human and inhuman. Those of us lucky enough to have youth before us than behind should have an honest conversation with ourselves. Having subsequent conversations with those close to us won’t be easy, but it’ll be inevitable.

The payoff, then, is having a set of goals that we viscerally believe in. It is indescribably freeing – a feeling too many of us haven’t yet felt.

Categories
Uncategorized

Messing with the operating system for humans

Before drugs, my friend assumed his eyes would always work like… well, eyes! Everyone’s eyes are different of course, some people can see better than others, some people are blind or visually impaired in some way, but he had assumed that eyes generally acted within the bounds of some laws set by the universe. Eyes were a thing that absorbed the world to the best of their ability and reported back to the brain as honestly as they could.

Then he did acid and entered another dimension for a bit.

When he came back, his understanding of reality had been toppled. He was like, “Wait, how did my body even do that? What is reality?! What are eyes?!” 

He hadn’t realized he had been living under assumptions about the axioms of the universe, but these false pillars became visible in their acid-induced shattering. If all it took was some chemical cajoling for his eyes and senses to transport him to another planet, what were the actual rules? Are there rules, or are there only defaults? What other invisible false pillars was he living his life by? 

And this is why he liked recreational drugs — because he could explore and challenge and unlock a new relationship with reality.

Though my friend didn’t quite put it that way. The way he phrased it to me was, “When I do acid, it’s like messing with the operating system for humans.”

Acid & Amazon Boxes

(Featured Image Photo Credit: Raimond Klavins/Unsplash)

Categories
Uncategorized

Optimising for optionality

The writer Ryan Holiday, in a post titled “The Definition of Success Is Autonomy

Today, I don’t define success the way that I did when I was younger. I don’t measure it in copies sold or dollars earned. I measure it in what my days look like and the quality of my creative expression: Do I have time to write? Can I say what I think? Do I direct my schedule or does my schedule direct me? Is my life enjoyable or is it a chore? In a word: autonomy. Do I have autonomy over what I do and think? Am I free?

For my entire career, I’ve made decisions based on what I now call optimising for optionality, the ability to pick and choose what I want to spend time, money, attention on.

That means avoiding and eliminating long-term commitments, thinking very carefully about what to commit to, but then committing to those fully.

This means disappointing people, not least myself, and letting go of relationships. But I’m in control of my time most of the time, which is what’s important to me.

And autonomy is optionality by a different name. It’s why I get instinctively what Holiday’s talking about.

I’d recommend having a solid optimisation function for your life. And revisit it every year.

(via Jeannette)

Categories
Uncategorized

Perils of Perpetual Performance

Towards the end of a truly long, revealing and upsetting journey through the world of TikTok influencers:

One thing that is so reliably upsetting about spending time with these social-media influencers is that they are all so garrulous and kind that for a minute you can’t help feel that they actually like you and enjoy having you around. The boys continue to refer to me by my on-court cognomen, Beanie Barrett, and they punctuate this endearment by enlisting me in several complicated handshakes, which makes me feel like a high school freshman.

But it’s especially discomfiting to realize that the influencers have a tendency to treat virtually everyone in their social orbit with the same kind of backslapping effervescence with which they have treated me, and that this stems from their inexorable online habit of entreating their viewers to like and leave comments on all their social-media posts, not because they’re sincerely interested in what their followers have to say, but because this kind of “engagement” with their content is the sole barometer by which brands—i.e., their employers—determine their online relevance.

Categories
Uncategorized

Hum saath-saath

… I watched a group of computer engineers hold a meeting in a drab hotel on Edgware Road, London, which discussed whether or not to introduce new internet protocols to counter hacks on western utilities such as energy systems.

For hours, they debated an anti-hacking protocol with the unwieldy name “draft-rhrd-tls-tls13-visibility-01”. Then came the moment of truth: a white-bearded engineer named Sean Turner solemnly addressed the crowd: “Please hum now if you support adoption [of this tool].”

A collective hum, like a Tibetan chant, erupted, and then Turner asked those who opposed the move to hum as well. A second — far louder — sound erupted. “So at this point there is no consensus to adopt this,” he declared. The protocol was put on ice.

This might seem odd; after all, the Internet Engineering Task Force is the group that built the internet and computer geeks appear to live in a “rational”, maths-based world. But the IETF has embraced this “fuzzy” ritual in recent years because the techies like being able to sense the mood of the entire group via humming — and get the type of multidimensional information that simple “yes-no” votes cannot reveal.

Indeed, these engineers are so attached to this ritual that they were very upset when they lost the ability to hum together during the Covid-19 lockdown — and although they tried to replicate what they liked about group humming with computer code, they realised it was impossible.

The human factor — why data is not enough to understand the world