The emergence of blockchains has fueled the development of resilient systems that deal with Byzantine failures due to crashes, bugs, or even malicious behavior. Recently, we have also seen the exploration of sharding in these resilient systems, this to provide the scalability required by very large data-based applications. Unfortunately, current sharded resilient systems all use system-specific specialized approaches toward sharding that do not provide the flexibility of traditional sharded data management systems. To improve on this situation, we fundamentally look at the design of sharded resilient systems. We do so by introducing ByShard, a unifying framework for the study of sharded resilient systems. Within this framework, we show how two-phase commit and two-phase locking—two techniques central to providing atomicity and isolation in traditional sharded databases—can be implemented efficiently in a Byzantine environment, this with a minimal usage of costly Byzantine resilient primitives. Based on these techniques, we propose eighteen multi-shard transaction processing protocols. Finally, we practically evaluate these protocols and show that each protocol supports high transaction throughput and provides scalability while each striking its own trade-off between throughput, isolation level, latency, and abort rate. As such, our work provides a strong foundation for the development of ACID-compliant general-purpose and flexible sharded resilient data management systems.

区块链的出现推动了弹性系统的发展，这些系统可以处理由于崩溃、错误甚至恶意行为导致的拜占庭式故障。最近，我们还看到了在这些弹性系统中对分片的探索，以提供非常大的基于数据的应用程序所需的可扩展性。不幸的是，当前的分片弹性系统都使用特定于系统的专门方法进行分片，这些方法不提供传统分片数据管理系统的灵活性。为了改善这种情况，我们从根本上着眼于分片弹性系统的设计。为此，我们引入了ByShard，这是一个用于研究分片弹性系统的统一框架。在这个框架内，我们展示了如何两阶段提交和两阶段锁定——在传统分片数据库中提供原子性和隔离的两种核心技术——可以在拜占庭环境中有效地实现，这需要最少使用昂贵的拜占庭弹性原语。基于这些技术，我们提出了十八个多分片交易处理协议。最后，我们实际评估了这些协议，并表明每个协议都支持高事务吞吐量并提供可扩展性，同时每个协议都在吞吐量、隔离级别、延迟和中止率之间进行权衡. 因此，我们的工作为开发符合 ACID 的通用和灵活的分片弹性数据管理系统奠定了坚实的基础。