Automation Glossary • Historian IOPS and disk sizing

What Is Historian IOPS and Disk Sizing?

Merobix Engineering • • 7 min read

A historian can have all the terabytes in the world and still fall over if the disk underneath cannot absorb writes fast enough. Retention sizing tells you how much space you need; IOPS and disk sizing tells you whether the storage can keep up with the incoming stream of samples in the first place. This guide covers the write side of a historian: how sample rate and tag count combine into a sustained input-output load, why time-series writes punish spinning disk, how hot and cold tiers split the work, and how to test disk performance before you commit a site to it.

Back to Blog

Historian IOPS and disk sizing in one line: Historian IOPS and disk sizing is the practice of estimating the sustained write load a historian's storage must handle, expressed as input-output operations per second and megabytes per second, from the number of tags multiplied by how fast they are sampled. Because that stream is continuous and often bursty, it usually demands solid-state or NVMe storage rather than spinning disk, and it is a distinct question from how many gigabytes are needed to retain the data over time.

Turning Sample Rate and Tag Count Into a Write Load

The write load on a historian starts from a simple product: how many tags are being collected and how often each one produces a sample. Ten thousand tags sampled once a second generate ten thousand values per second that have to be received, timestamped, compressed, and committed to storage. Change that to once every ten seconds and the rate drops tenfold; change it to sub-second sampling on a fast process and it climbs sharply. That per-second value rate is the raw ingredient, and it translates into both an operations figure, the input-output operations per second the disk must sustain, and a throughput figure in megabytes per second once you account for how many values are batched into each physical write.

The relationship between values per second and disk operations per second is not one-to-one, and that distinction matters. A well-designed historian batches many samples into each write and applies compression so that it is not issuing a separate disk operation for every value, which is what keeps the sustained IOPS manageable. But there is a floor set by how often data must be flushed to be considered safely stored, and there are periodic operations - index updates, archive rollovers, partition creation - that add their own bursts. Sizing means estimating the steady per-second write demand and then allowing for these recurring spikes on top.

Two systems with identical retention needs can therefore place very different demands on their disks. A slow process logging a modest number of tags every few seconds writes a gentle, easily absorbed stream, while a large plant sampling many fast tags sub-second produces a relentless torrent that only fast storage can keep up with. This is exactly why disk performance sizing is separate from capacity sizing: the gigabytes retained might be the same, but the operations per second required to get the data down without falling behind can differ by orders of magnitude.

Why Time-Series Writes Need SSD or NVMe

Time-series ingestion is a punishing workload for storage because it is write-heavy, continuous, and often bursty in a way that spinning disk handles badly. A traditional hard drive is fast for large sequential transfers but slow whenever it has to reposition its heads for scattered operations, and the mix of steady sample writes plus periodic index and archive activity produces exactly the kind of small, frequent, partly random operations that expose that weakness. When the disk cannot keep up, the historian's buffers fill, back-pressure builds, and the collector either stalls or starts dropping data - the failure mode a historian must never have.

Solid-state and NVMe storage remove the mechanical bottleneck. With no heads to reposition, they sustain far higher operations per second and hold their performance under the bursty, mixed pattern that a historian generates, so the incoming stream is absorbed with margin to spare rather than at the edge of what the disk can manage. For any historian collecting a meaningful number of tags at a real sample rate, flash storage is now the practical default for the active write path, and spinning disk is relegated to roles where raw throughput per gigabyte matters more than operations per second.

The consequence of getting this wrong is not slow queries, which users would notice and complain about, but silent data loss, which they might not notice until they need the missing history. A disk that cannot sustain the write load causes gaps precisely during busy periods when the plant is most active and the data is most valuable. That asymmetry - cheap to over-provision write performance, expensive and often invisible to under-provision it - is why the write side deserves its own careful sizing rather than being assumed to be fine because there is enough space.

Tiering, Testing, and Historians in Cloud SCADA

Not all historian data needs the same disk performance, and tiering exploits that. Recent data, the hot tier, is written constantly and queried often, so it lives on the fastest storage where both ingestion and interactive queries are quick. Older data, the cold tier, is rarely touched after it ages out, so it can migrate to cheaper, slower, higher-capacity storage where the low operations-per-second and modest throughput are perfectly adequate. Splitting the workload this way lets a design put its expensive fast storage only where the demanding write stream and live queries actually land, while still retaining years of history economically on cheaper media.

Whatever the plan, disk should be tested before commissioning rather than trusted from a spec sheet. A storage benchmark that mimics the historian's real pattern - many small, frequent, partly random writes sustained over time rather than a single big sequential transfer - reveals whether the storage can hold the required operations per second under continuous load, and it surfaces the difference between burst performance and sustained performance that catalogues rarely make clear. Testing against the actual expected write rate, with headroom for peaks, turns disk sizing from a hopeful assumption into a verified number before a site goes live.

In a cloud SCADA context such as Merobix, the write-side burden shifts to managed, elastic storage that is provisioned and tiered centrally rather than sized disk-by-disk at every site. For a fleet of remote wellpads, tanks, and compressor stations continuously streaming samples, the aggregate write load is planned once for the platform, with fast storage on the active ingest path and cheaper tiers for aged history, and it scales as more sites come online. That centralisation does not remove the underlying arithmetic - sample rate times tag count still sets the load - but it means the demanding write path is engineered and monitored in one place rather than depending on whatever disk happened to be installed at each location.

Frequently Asked Questions

How is historian IOPS sizing different from capacity or retention sizing?

Capacity sizing answers how many gigabytes you need to keep the data for the required period, while IOPS and disk sizing answers whether the storage can absorb the incoming writes fast enough in the first place. Two historians can need the same total space but very different write performance, because IOPS depends on how fast samples arrive, not how long they are kept. A disk with plenty of room can still fail if it cannot sustain the operations per second the sample stream demands.

Can a historian run on spinning hard drives?

For light workloads with few tags and slow sample rates, spinning disk may cope, but for any meaningful tag count at real sample rates the mix of continuous small writes plus periodic index and archive activity overwhelms mechanical drives. When the disk cannot keep up, buffers fill and the historian starts dropping data. Solid-state or NVMe storage is the practical default for the active write path because it sustains high operations per second under that bursty pattern.

How do you test whether a disk can handle the historian write load?

Run a storage benchmark that mimics the historian's real pattern rather than a single large sequential transfer: many small, frequent, partly random writes sustained continuously over time. That reveals the disk's sustained operations-per-second under the workload it will actually see and exposes any gap between short burst performance and long-run performance. Test against the expected write rate with headroom for peaks so you verify the storage before commissioning rather than discovering gaps in production.

From Definitions to a Live Dashboard

Merobix reads your field devices into a cloud SCADA - the real thing behind these terms, live in days from any browser.

Request a Free Demo +1 (903) 307-7300
More in Automation Glossary
SCADA license server  •  Concurrent vs named-user licensing  •  Tag-based SCADA license  •  License audit and true-up  •  HTML5 thin client  •  Terminal server for SCADA  •  All Automation Glossary →
Free SCADA operator training
Merobix University - 70 video lessons & 261 quiz questions, from first login to compliance reporting. No demo call required.
Start free →