Data Center Handbook Plan Design Build And Operations Of A Smart Data Center 2Nd Edition Edition Hwaiyu Geng full chapter pdf docx

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 70

Data Center Handbook: Plan, Design,

Build, And Operations Of A Smart Data


Center 2nd Edition Edition Hwaiyu
Geng
Visit to download the full and correct content document:
https://ebookmass.com/product/data-center-handbook-plan-design-build-and-operatio
ns-of-a-smart-data-center-2nd-edition-edition-hwaiyu-geng/
More products digital (pdf, epub, mobi) instant
download maybe you interests ...

Semiconductor Manufacturing Handbook, Second Edition


Hwaiyu Geng [Geng

https://ebookmass.com/product/semiconductor-manufacturing-
handbook-second-edition-hwaiyu-geng-geng/

Management of Data Center Networks Nadjib Aitsaadi

https://ebookmass.com/product/management-of-data-center-networks-
nadjib-aitsaadi/

Security operations center guidebook - a practical


guide for a successful SOC Mccoy

https://ebookmass.com/product/security-operations-center-
guidebook-a-practical-guide-for-a-successful-soc-mccoy/

Data Engineering with AWS: Acquire the skills to design


and build AWS-based data transformation pipelines like
a pro 2nd Edition Eagar

https://ebookmass.com/product/data-engineering-with-aws-acquire-
the-skills-to-design-and-build-aws-based-data-transformation-
pipelines-like-a-pro-2nd-edition-eagar/
Data Modeling and Database Design 2nd Edition, (Ebook
PDF)

https://ebookmass.com/product/data-modeling-and-database-
design-2nd-edition-ebook-pdf/

Handbook of Pediatric Hematology and Oncology Caroline


A. Hastings

https://ebookmass.com/product/handbook-of-pediatric-hematology-
and-oncology-caroline-a-hastings/

The Bodyguard: A Novel Katherine Center

https://ebookmass.com/product/the-bodyguard-a-novel-katherine-
center/

Hello Stranger: A Novel Katherine Center

https://ebookmass.com/product/hello-stranger-a-novel-katherine-
center/

Human Factors Handbook for Process Plant Operations:


Improving Process Safety and System Performance 1st
Edition Ccps (Center For Chemical Process Safety)

https://ebookmass.com/product/human-factors-handbook-for-process-
plant-operations-improving-process-safety-and-system-
performance-1st-edition-ccps-center-for-chemical-process-safety/
DATA CENTER HANDBOOK
DATA CENTER HANDBOOK
Plan, Design, Build, and Operations of a Smart
Data Center

Second Edition
HWAIYU GENG, P.E.
Amica Research
Palo Alto, California, United States of America
This second edition first published 2021
© 2021 by John Wiley & Sons, Inc.

Edition History
John Wiley & Sons, Inc. (1e, 2015)

All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic,
mechanical, photocopying, recording or otherwise, except as permitted by law. Advice on how to obtain permission to reuse material from this title is
available at http://www.wiley.com/go/permissions.

The right of Hwaiyu Geng, P.E. to be identified as the editor of the editorial material in this work has been asserted in accordance with law.

Registered Office
John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, USA

Editorial Office
111 River Street, Hoboken, NJ 07030, USA

For details of our global editorial offices, customer services, and more information about Wiley products visit us at www.wiley.com.

Wiley also publishes its books in a variety of electronic formats and by print‐on‐demand. Some content that appears in standard print versions of this book
may not be available in other formats.

Limit of Liability/Disclaimer of Warranty


While the publisher and authors have used their best efforts in preparing this work, they make no representations or warranties with respect to the accuracy or
completeness of the contents of this work and specifically disclaim all warranties, including without limitation any implied warranties of merchantability or
fitness for a particular purpose. No warranty may be created or extended by sales representatives, written sales materials or promotional statements for this
work. The fact that an organization, website, or product is referred to in this work as a citation and/or potential source of further information does not mean
that the publisher and authors endorse the information or services the organization, website, or product may provide or recommendations it may make. This
work is sold with the understanding that the publisher is not engaged in rendering professional services. The advice and strategies contained herein may not
be suitable for your situation. You should consult with a specialist where appropriate. Further, readers should be aware that websites listed in this work may
have changed or disappeared between when this work was written and when it is read. Neither the publisher nor authors shall be liable for any loss of profit
or any other commercial damages, including but not limited to special, incidental, consequential, or other damages.

Library of Congress Cataloging‐in‐Publication Data

Names: Geng, Hwaiyu, editor.


Title: Data center handbook : plan, design, build, and operations of a
smart data center / edited by Hwaiyu Geng.
Description: 2nd edition. | Hoboken, NJ : Wiley, 2020. | Includes index.
Identifiers: LCCN 2020028785 (print) | LCCN 2020028786 (ebook) | ISBN
9781119597506 (hardback) | ISBN 9781119597544 (adobe pdf) | ISBN
9781119597551 (epub)
Subjects: LCSH: Electronic data processing departments–Design and
construction–Handbooks, manuals, etc. | Electronic data processing
departments–Security measures–Handbooks, manuals, etc.
Classification: LCC TH4311 .D368 2020 (print) | LCC TH4311 (ebook) | DDC
004.068/4–dc23
LC record available at https://lccn.loc.gov/2020028785
LC ebook record available at https://lccn.loc.gov/2020028786

Cover Design: Wiley


Cover Image: Particle earth with technology network over Chicago Cityscape © Photographer is my life. / Getty Images, front cover
icons © Macrovector / Shutterstock except farming icon © bioraven / Shutterstock

Set in 10/12pt Times by SPi Global, Pondicherry, India

10 9 8 7 6 5 4 3 2 1
To “Our Mothers Who Cradle the World” and To “Our Earth Who Gives Us Life.”
BRIEF CONTENTS

ABOUT THE EDITOR/AUTHORix

TAB MEMBERS xi
CONTRIBUTORS xiii
FOREWORDS xv
PREFACES xxi
ACKNOWLEDGEMENTS xxv

PART I DATA CENTER OVERVIEW AND STRATEGIC PLANNING

(Chapter 1–7, Pages 1–127)

PART II DATA CENTER TECHNOLOGIES

(Chapter 8–21, Pages 143–359)

PART III DATA CENTER DESIGN & CONSTRUCTION

(Chapter 22–31, Pages 367–611)

PART IV DATA CENTER OPERATIONS MANAGEMENT

(Chapter 32–37, Pages 617–675)

vii
ABOUT THE EDITOR/AUTHOR

Hwaiyu Geng, CMfgE, P.E., is a principal at Amica Research h­ igh­tech projects. He is a frequent speaker in international
(Palo Alto, California, USA) promoting green technological conferences, universities, and has presented many technical
and manufacturing programs. He has had over 40 years of papers. A patent holder, Mr. Geng is also the editor/author of
diversified technological and management e­xperience, the Data Center Handbook (2ed), Manufacturing Engineering
worked with Westinghouse, Applied Materials, Hewlett‐ Handbook (2ed), Semiconductor Manufacturing Handbook
Packard, Intel, and Juniper Network on international (2ed), and the IoT and Data Analytics Handbook.

ix
TECHNICAL ADVISORY BOARD

Amy Geng, M.D., Institute for Education, Washington, Malik Megdiche, Ph.D., Schneider Electric, Eybens,
District of Columbia, United States of America France
Bill Kosik P.E., CEM, LEED AP, BEMP, DNV GL Energy Robert E. McFarlane, ASHRAE TC9.9 Corresponding
Services USA, Oak Park, Illinois, United States of America member, ASHRAE SSPC 90.4 Voting Member, Marist
College Adjunct Professor, Shen Milsom & Wilke
David Fong, Ph.D., CITS Group, Santa Clara, California,
LLC, New York City, New York, United States of
United States of America
America
Dongmei Huang, Ph.D., Rainspur Technology, Beijing, China
Robert Tozer, Ph.D., MBA, CEng, MCIBSE, MASHRAE,
Hwaiyu Geng, P.E., Amica Research, Palo Alto, California, Operational Intelligence, Ltd., London, United Kingdom
United States of America
Roger R. Schmidt, Ph.D., P.E. National Academy of
Jay Park, P.E., Facebook, Inc., Fremont, California, United Engineering Member, Traugott Distinguished Professor,
States of America Syracuse University, IBM Fellow Emeritus (Retired),
Syracuse, New York, United States of America
Jonathan Jew, Co-Chair TIA TR, BICSI, ISO Standard,
J&W Consultants, San Francisco, California, United States Yihlin Chan, Ph.D., Occupational Safety and Health
of America Administration (Retired), Salt Lake City, Utah, United
States of America
Jonathan Koomey, Ph.D., President, Koomey Analytics,
Burlingame, California, United States of America

xi
LIST OF CONTRIBUTORS

Ken Baudry, K.J. Baudry, Inc., Atlanta, Georgia, United Hubertus Franke, IBM, Yorktown Heights, New York,
States of America United States of America
Sergio Bermudez, IBM TJ Watson Research Center, Ajay Garg, Intel Corporation, Hillsboro, Oregon, United
Yorktown Heights, New York, United States of America States of America
David Bonneville, Degenkolb Engineers, San Francisco, Chang‐Hsin Geng, Supermicro Computer, Inc., San Jose,
California, United States of America California, United States of America
David Cameron, Operational Intelligence Ltd, London, Hwaiyu Geng, Amica Research, Palo Alto, California,
United Kingdom United States of America
Ronghui Cao, College of Information Science and Hendrik Hamann, IBM TJ Watson Research Center,
Engineering, Hunan University, Changsha, China Yorktown Heights, New York, United States of America
Nicholas H. Des Champs, Munters Corporation, Buena Sarah Hanna, Facebook, Fremont, California, United States
Vista, Virginia, United States of America of America
Christopher Chen, Jensen Hughes, College Park, Maryland,
Skyler Holloway, Facebook, Menlo Park, California, United
United States of America
States of America
Chris Crosby, Compass Datacenters, Dallas, Texas, United
Ching‐I Hsu, Raritan, Inc., Somerset, New Jersey, United
States of America
States of America
Chris Curtis, Compass Datacenters, Dallas, Texas, United
States of America Dongmei Huang, Beijing Rainspur Technology, Beijing,
China
Sean S. Donohue, Jensen Hughes, Colorado Springs,
Colorado, United States of America Robert Hunter, AlphaGuardian, San Ramon, California,
United States of America
Keith Dunnavant, Munters Corporation, Buena Vista,
Virginia, United States of America Phil Isaak, Isaak Technologies Inc., Minneapolis, Minnesota,
United States of America
Mark Fisher, Munters Corporation, Buena Vista, Virginia,
United States of America Alexander Jew, J&M Consultants, Inc., San Francisco,
California, United States of America
Sophia Flucker, Operational Intelligence Ltd, London,
United Kingdom Masatoshi Kajimoto, ISACA, Tokyo, Japan

xiii
xiv LIST OF CONTRIBUTORS

Levente Klein, IBM TJ Watson Research Center, Yorktown Jay Park, Facebook, Fremont, California, United States of
Heights, New York, United States of America America
Bill Kosik, DNV Energy Services USA Inc., Chicago, Robert Pekelnicky, Degenkolb Engineers, San Francisco,
Illinois, United States of America California, United States of America
Nuoa Lei, Northwestern University, Evanston, Illinois, Robert Reid, Panduit Corporation, Tinley Park, Illinois,
United States of America United States of America
Bang Li, Eco Atlas (Shenzhen) Co., Ltd, Shenzhen, China Mark Seymour, Future Facilities, London, United Kingdom
Chung‐Sheng Li, PricewaterhouseCoopers, San Jose, Dror Shenkar, Intel Corporation, Israel
California, United States of America
Ed Spears, Eaton, Raleigh, North Carolina, United States of
Kenli Li, College of Information Science and Engineering, America
Hunan University, Changsha, China
Richard T. Stuebi, Institute for Sustainable Energy, Boston
Keqin Li, Department of Computer Science, State University, Boston, Massachusetts, United States of
University of New York, New Paltz, New York, United America
States of America
Mark Suski, Jensen Hughes, Schaumburg, Illinois, United
Weiwei Lin, School of Computer Science and Engineering, States of America
South China University of Technology, Guangzhou, China
Zhuo Tang, College of Information Science and Engineering,
Chris Loeffler, Eaton, Raleigh, North Carolina, United Hunan University, Changsha, China
States of America
Robert Tozer, Operational Intelligence Ltd, London, United
Fernando Marianno, IBM TJ Watson Research Center, Kingdom
Yorktown Heights, New York, United States of America
John Weale, The Integral Group, Oakland, California, United
Eric R. Masanet, Northwestern University, Evanston, States of America
Illinois, United States of America
Joseph Weiss, Applied Control Solutions, Cupertino,
Robert E. Mcfarlane, Shen Milsom & Wilke LLC, New California, United States of America
York, New York, United States of America Marist College,
Beth Whitehead, Operational Intelligence Ltd, London,
Poughkeepsie, New York, United States of America
United Kingdom
ASHRAE TC 9.9, Atlanta, Georgia, United States of
America ASHRAE SSPC 90.4 Standard Committee, Jan Wiersma, EVO Venture Partners, Seattle, Washington,
Atlanta, Georgia, United States of America United States of America
Malik Megdiche, Schneider Electric, Eybens, France Wentai Wu, Department of Computer Science, University of
Warwick, Coventry, United Kingdom
Christopher O. Muller, Muller Consulting, Lawrenceville,
Georgia, United States of America Chao Yang, Chongqing University, Chongqing, China
Liam Newcombe, Romonet, London, United Kingdom Ligong Zhou, Raritan, Inc., Beijing, China
FOREWORD (1)

The digitalization of our economy requires data centers to i­nfrastructure. Server rooms might have more computing
continue to innovate to meet the new needs for connectivity, power in the same area, but they will also need more power
growth, security, innovation, and respect for the environment and cooling to match. Institutions are also moving to install
demanded by organizations. Every phase of life is putting advanced applications and workloads related to AI, which
increased pressure on data centers to innovate at a rapid requires high‐performance computing. To date, these racks
pace. Explosive growth of data driven by 5G, Internet of represent a very small percentage of total racks, but they
Things (IoT), and Artificial Intelligence (AI) is changing the nevertheless can present unfamiliar power and cooling chal-
way data is stored, managed, and transferred. As this volume lenges that must be addressed. The increasing interest in
grows, data and applications are pulled together, requiring direct liquid cooling is in response to high‐performance
more and more computing and storage resources. The ques- computing demands.
tion facing data center designers and operators is how to plan 5G enables a new kind of network that is designed to con-
for the future that accomplishes the security, flexibility, scal- nect virtually everyone and everything together including
ability, adaptability, and sustainability needed to support machines, objects, and devices. It will require more band-
business requirements. width, faster speeds, and lower latency, and the data center
With this explosion of data, companies need to think more infrastructure must be flexible and adaptable in order to
carefully and strategically about how and where their data is accommodate these demands. With the need to bring comput-
stored, and the security risks involved in moving data. The ing power closer to the point of connectivity, the end user is
sheer volume of data creates additional challenges in protect- driving demand for edge data centers. Analyzing the data
ing it from intrusions. This is probably one of the most impor- where it is created rather than sending it across various net-
tant concerns of the industry – how to protect data from being works and data centers helps to reduce response latency,
hacked and being compromised in a way that would be thereby removing a bottleneck from the decision‐making
extremely damaging to their core business and the trust of process. In most cases, these data centers will be, remotely
their clients. managed and unstaffed data centers. Machine learning will
Traditional data centers must deliver a degree of scalabil- enable real‐time adjustments to be made to the infrastructure
ity to accommodate usage needs. With newer technologies without the need for human interaction.
and applications coming out daily, it is important to be able With data growing exponentially, data centers may be
to morph the data center into the needs of the business. It is impacted by significant increases in energy usage and carbon
equally important to be able to integrate these technologies footprint. Hyperscalers have realized this and have increas-
in a timely manner that does not compromise the strategic ingly used more and more sustainable technologies. This
plans of the business. With server racks getting denser every trend will cause others to follow and adopt some of the build-
few years, the rest of the facility must be prepared to support ing technologies and use of renewables for their own data
an ever increasing power draw. A data center built over the centers. The growing mandate for corporations to shift to a
next decade must be expandable to accommodate for future greener energy footprint lays the groundwork for new
technologies, or risk running out of room for support approaches to data center power.

xv
xvi Foreword (1)
FOREWORD

The rapid innovations that are occurring inside (edge their l­atest thinking on these issues. This handbook is the
computing, liquid cooling, etc.) and outside (5G, IoT, etc.) most comprehensive guide available to data center practi-
of data centers will require careful and thoughtful analysis tioners as well as academia.
to design and operate a data center for the future that will
serve the strategic imperatives of the business it supports. To Roger R. Schmidt, Ph.D.
help address the complex environment with competing Member, National Academy of Engineering
forces, this second edition of the Data Center Handbook has Traugott Distinguished Professor, Syracuse University
assembled by leaders in the industry and a­ cademia to share IBM Fellow Emeritus (Retired)
FOREWORD (2)

A key driver of innovation in modern industrial societies in in 2010). Electricity use grew only 6% even as the number of
the past two centuries is the application of what researchers compute instances, data transfers, and total data storage capac-
call “general purpose technologies,” which have far‐ranging ity grew to be 6.5 times, 11 times, and 26 times as large in
effects on the way the economy produces value. Some impor- 2018 as each was in 2010, respectively.
tant examples include the steam engine, the telegraph, the The industry was able to keep data center electricity use
electric power grid, the internal combustion engine, and most almost flat in absolute terms from 2010 to 2018 because of
recently, computers and related information and the adoption of best practices outlined in more detail in this
­communications technologies (ICTs). volume. The most consequential of these best practices was
ICTs represent the most powerful general‐purpose tech- the rapid adoption of hyperscale data centers, known collo-
nologies humanity has ever created. The pace of innovation quially as cloud computing. Computing output and data
across virtually all industries is accelerating, which is a direct transfers increased rapidly, but efficiency also increased
result of the application of ICTs to increase efficiency, ­rapidly, almost completely offsetting growth in demand for
enhance organizational effectiveness, and reduce costs of computing services.
manufacturing products. Services provided by data centers For those new to the world of data centers and information
enable virtually all ICTs to function better. technology, this lesson is surprising. Even though data cent-
This volume presents a comprehensive look at the current ers are increasingly important to the global economy, they
state of the data center industry. It is an essential resource for don’t use a lot of electricity in total, because innovation has
those working in the industry, and for those who want to rapidly increased their efficiency over time. If the industry
understand where it is headed. aggressively adopts the advanced technologies and ­practices
The importance of the data center industry has led to many described in this volume, they needn’t use a lot of electricity
misconceptions, the most common of which involves inflated in the future, either.
estimates of how much electricity data centers use. The latest I hope analysts and practitioners around the world find this
credible estimates for global electricity use of data centers are volume useful. I surely will!
for 2018, from our article in Science Magazine in February
2020 (Masanet et al. 2020). Jonathan Koomey, Ph.D.,
According to this analysis, data centers used about 0.9% of President, Koomey Analytics
the world’s electricity consumption in 2018 (down from 1.1% Bay Area, California

xvii
FOREWORD (3)

The data center industry changes faster than any publication standstill. And that’s just the personal side. Reliable, f­ lexible,
can keep up with. So why the “Data Center Handbook”? There and highly adaptable computing facilities are now necessary to
are many reasons, but three stand out. First, fundamentals have our very existence. Businesses have gone bankrupt after com-
not changed. Computing equipment may have dramatically puting failures. In health care and public safety, the availability
transformed in processing power and form factor since the first of those systems can literally spell life or death.
mainframes appeared, but it is still housed in secure rooms, it In this book you will find chapters on virtually every topic
still uses electricity, it still produces heat, it must still be cooled, you could encounter in designing and operating a data
it must still be protected from fire, it must still be connected to center – each chapter written by a recognized expert in the field,
its users, and it must still be managed by humans who possess highly experienced in the challenges, complexities, and eccen-
an unusual range of knowledge and an incredible ability to tricities of data center systems and their supporting infrastruc-
adapt to fast changing requirements and conditions. Second, tures. Each section has been brought up‐to‐date from the
new people are constantly entering what, to them, is this brave previous edition of this book as of the time of publication. But
new world. They benefit from having grown up with a com- as this book was being assembled, the COVID 19 pandemic
puter (i.e., “smart phone”) in their hands, but are missing the occurred, putting unprecedented demands on computing sys-
contextual background behind how it came to be and what is tems overnight. The industry reacted, proving beyond question
needed to keep it working. Whether they are engineers design- its ability to respond to a crisis, adapt its operating practices to
ing their first enterprise, edge computing, hyperscale or liquid unusual conditions, and meet the inordinate demands that
cooled facility, or IT professionals given their first facility or quickly appeared from every industry, government, and indi-
system management assignment within it, or are students trying vidual. A version of the famous Niels Bohr quote goes, “An
to grasp the enormity of this industry, having a single reference expert is one who, through his own painful experience, has
book is far more efficient than plowing through the hundreds of learned all the mistakes in a given narrow field.” Adherence to
articles published in multiple places every month. Third, and the principles and practices set down by the authors of this
perhaps even more valuable in an industry that changes so rap- book, in most cases gained over decades through their own per-
idly, is having a volume that also directs you to the best industry sonal and often painful experiences, enabled the computing
resources when more or newer information is needed. industry to respond to that c­ risis. It will be the continued adher-
The world can no longer function without the computing ence to those principles, honed as the industry continues to
industry. It’s not regulated like gas and electric, but it’s as change and mature, that will empower it to respond to the next
critical as any utility, making it even more important for the critical situation. The industry should be grateful that the knowl-
IT industry to maintain itself reliably. When IT services fail, edge of so many experts has been assembled into one volume
we are even more lost than in a power outage. We can use from which everyone in this industry can gain new knowledge.
candles to see, and perhaps light a fireplace to stay warm. We
can even make our own entertainment! But if we can’t get Robert E. McFarlane
critical news, can’t pay a bill on time, or can’t even make a Principal, Shen Milsom & Wilke, LLC
critical phone call, the world as we now know it comes to a Adjunct Faculty – Marist College, Poughkeepsie, NY

xix
PREFACE DATA CENTER HANDBOOK
(SECOND EDITION, 2021)

As Internet of Things, data analytics, artificial intelligence, both emerging technologies and best practices. The hand-
5G, and other emerging technologies revolutionize the book is divided into four parts:
­services and products companies, the demand for computing Part I: Data Center Overview and Strategic Planning that
power grows along the value chain between edge and cloud. provides an overview of data center strategic planning, while
Data centers need to improve and advance continuously to considering the impact of emerging technologies. This section
fulfill this demand. also addresses energy demands, sustainability, edge to cloud
To meet the megatrends of globalization, urbanization, computing, financial analysis, and managing data center risks.
demographic changes, technology advancements, and sus- Part II: Data Center Technologies that covers technologies
tainability concerns, C‐suite executives and technologists applicable to data centers. These include software‐defined
must work together in preparing strategic plans for deploying applications, infrastructure, resource management, ASHRAE3
data centers around the world. Workforce developments and thermal guidelines, design of energy‐efficient IT equipment,
the redundancy of infrastructures required between edge and wireless sensor network, telecommunication, rack level and
cloud need to be considered in building and positioning data server level cooling, data center corrosion and contamination
centers globally. control, cabling, cybersecurity, and data center microgrids.
Whether as a data center designer, user, manager, researcher, Part III: Data Center Design and Construction that dis-
professor, or student, we all face increasing challenges in a cusses plan, design, and construction of a data center that
cross‐functional environment. For each data center project, we includes site selection, facility layout and rack floor plan,
should ask, what are the goals, and work out “How to Solve It.”1 mechanical design, electrical design, structural design, fire
To do this, we can employ a 5W1H2 approach applying data protection, computational fluid dynamics, and project man-
analytics and nurture the creativity that is needed for invention agement for construction.
and innovation. Additionally, a good understanding of the anat- Part IV: Data Center Operations that covers data center
omy, ecosystem, and taxonomy, of a data center will help us benchmarking, data center infrastructure management
­
master and solve this complex problem. (DCIM), energy efficiency assessment, and AI applications
The goal of this Data Center Handbook is to provide for data centers. This section also reviews lessons imparted
readers with the essential knowledge that is needed to plan, from disasters, and includes mitigation strategies to ensure
build, and operate a data center. This handbook embraces business continuity.

1
Polya, G. How to Solve It. Princeton: Princeton University Press; 1973. 3
ASHRAE is the American Society of Heating, Refrigerating, and
2
The 5W1H are “Who, What, When, Where, Why, and How.” Air-Conditioning Engineers.

xxi
xxii Preface Data Center Handbook (Second Edition, 2021)

Containing 453 figures, 101 tables and 17 pages in the enlightening resource for global data center practitioners, and
index section, this second edition of Data Center Handbook will be a useful reference book for anyone whose work
is a single‐volume, comprehensive guide to this field. The requires data centers.
handbook covers the breadth and depth of data center tech- Hwaiyu Geng, CMfgE, P.E.
nologies, and includes the latest updates from this fast‐chang- Palo Alto, California, United States of America
ing field. It is meant to be a relevant, practical, and
PREFACE DATA CENTER HANDBOOK
(FIRST EDITION, 2015)

Designing and operating a sustainable data center (DC) ment mission‐critical DC projects successfully. The goal of
requires technical knowledge and skills from strategic plan- this handbook is to provide DC practitioners with essential
ning, complex technologies, available best practices, opti- knowledge needed to implement DC design and construction,
mum operating efficiency, disaster recovery, and more. apply IT technologies, and continually improve DC opera-
Engineers and managers all face challenges operating tions. This handbook embraces both conventional and emerg-
across functionalities, for example, facilities, IT, engineering, ing technologies, as well as best practices that are being used in
and business departments. For a mission‐critical, sustainable the DC industry. By applying the information contained in the
DC project, we must consider the following: handbook, we can accelerate the pace of innovations to
reduce energy consumption and carbon emissions and to
• What are the goals? “Save Our Earth Who Gives Us Life.”
• What are the givens? The handbook covers the following topics:
• What are the constraints?
• What are the unknowns? • DC strategic planning
• Which are the feasible solutions? • Hosting, colocation, site selection, and economic
justifications
• How is the solution validated?
• Plan, design, and implement a mission‐critical facility
How does one apply technical and business knowledge to • IT technologies including virtualization, cloud, SDN,
develop an optimum solution plan that considers emerging and SDDC
technologies, availability, scalability, sustainability, agility, • DC rack layout and MEP design
resilience, best practices, and rapid time to value? The list can • Proven and emerging energy efficiency technologies
go on and on. Our challenges may be as follows: • DC project management and commissioning
• DC operations
• To prepare a strategic location plan
• Disaster recovery and business continuity
• To design and build a mission‐critical DC with energy‐
efficient infrastructure
Each chapter includes essential principles, design, and
• To apply best practices thus consuming less energy operations considerations, best practices, future trends, and
• To apply IT technologies such as cloud and virtualiza- further readings. The principles cover fundamentals of a
tion and technology and its applications. Design and operational
• To manage DC operations thus reducing costs and considerations include system design, operations, safety,
­carbon footprint security, environment issues, maintenance, economy, and
best practices. There are useful tips for planning, imple-
A good understanding of DC components, IT technologies, menting, and controlling operational processes. The future
and DC operations will enable one to plan, design, and imple- trends and further reading sections provide visionary views
xxiii
xxiv PREFACE DATA CENTER HANDBOOK (FIRST EDITION, 2015)

and lists of relevant books, technical papers, and websites • Network, Cabling, and Communication Engineers
for additional reading. • Server, Storage, and Application Managers
This Data Center Handbook is specifically designed to • IT Project Managers
provide technical knowledge for those who are responsible
• IT Consultants
for the design, construction, and operation of DCs. It is also
useful for DC decision makers who are responsible for strate- • Architects and MEP Consultants
gic decisions regarding capacity planning and technology • Facilities Managers and Engineers
investments. The following professionals and managers will • Real Estate Portfolio Managers
find this handbook to be a useful and enlightening resource: • Finance Managers

• C‐level Executives (Chief Information Officer, Chief This Data Center Handbook is prepared by more than 50
Technology Officer, Chief Operating Officer, Chief world‐class professionals from eight countries around the
Financial Officer) world. It covers the breadth and depth of DC planning,
• Data Center Managers and Directors designing, construction, and operating enterprise, govern-
• Data Center Project Managers ment, telecommunication, or R&D Data Centers. This Data
• Data Center Consultants Center Handbook is sure to be the most comprehensive sin-
gle‐source guide ever published in its field.
• Information Technology and Infrastructure Managers
• Network Operations Center and Security Operations Hwaiyu Geng, CMfgE, P.E.
Center Managers Palo Alto, California, United States of America
ACKNOWLEDGEMENTS
DATA CENTER HANDBOOK (SECOND EDITION, 2021)

The Data Center Handbook is a collective representation of • Mark Seymour, Future Facilities
an international community with scientists and professionals • Robert Tozer, Operational Intelligence
comprising 58 experts from six countries around the world. • John Weale, the Integral Group.
I am very grateful to the members of the Technical
Advisory Board for their diligent reviews of this handbook, This book benefited from the following organizations and
confirming technical accuracy while contributing their institutes and more:
unique perspectives. Their guidance has been invaluable to
ensure that the handbook can meet the needs of a broad • 7×24 Exchange International
audience.
• ASHRAE (American Society of Heating, Refrigerating,
I gratefully acknowledge to the contributors who share
and Air Conditioning Engineers)
their wisdom and valuable experiences in spite of their busy
schedules and personal lives. • Asetek
Without the trust and support from our team members, • BICSI (Building Industry Consulting Service
this handbook could not have been completed. Their col- International)
lective effort has resulted in a work that adds tremendous • Data Center Knowledge
value to the data center community. • Data Center Dynamics
Thanks must go to the following individuals for their • ENERGY STAR (the U.S. Energy Protection Agency)
advice, support, and contribution:
• European Commission Code of Conduct
• Nicholas H. Des Champs, Munters Corporation • Federal Energy Management Program (the U.S. Dept.
of Energy)
• Mark Gaydos, Nlyte Software
• Gartner
• Dongmei Huang, Rainspur Technology
• Green Grid, The
• Phil Isaak, Isaak Technologies
• IDC (International Data Corporation)
• Jonathan Jew, J&M Consultants
• Japan Data Center Council
• Levente Klein, IBM
• LBNL (the U.S. Dept. of Energy, Lawrence Berkeley
• Bill Kosik, DNV Energy Services USA Inc.
National Laboratory)
• Chung‐Sheng Li, PricewaterhouseCoopers
• LEED (the U.S. Green Building Council, Leadership in
• Robert McFarlane, Shen Milsom & Wilke Energy and Environmental Design)
• Malik Megdiche, Schneider Electric • McKinsey Global Institute
• Christopher Muller, Muller Consulting • Mission Critical Magazine
• Liam Newcombe, Romonet Ltd. • NIST (the U.S. Dept. of Commerce, National Institute
• Roger Schmidt, National Academy of Engineering Member of Standards and Technology)

xxv
xxvi Data Center Handbook (Second Edition, 2021)

• NOAA (the U.S. Dept. of Commerce, National Oceanic Thanks are also due to Brett Kurzman and staff at Wiley for
and Atmospheric Administration) their support and guidance.
• NASA (the U.S. Dept. of Interior, National Aeronautics My special thanks to my wife, Limei, my daughters, Amy
and Space Administration) and Julie, and my grandchildren, Abby, Katy, Alex, Diana,
• Open Compute Project and David, for their support and encouragement while I was
preparing this book.
• SPEC (Standard Performance Evaluation Corporation)
Hwaiyu Geng, CMfgE, P.E.
• TIA (Telecommunications Industry Association) Palo Alto, California, United States of America
• Uptime Institute/451 Research
ACKNOWLEDGMENTS
DATA CENTER HANDBOOK (FIRST EDITION, 2015)

The Data Center Handbook is a collective representation of Roger Schmidt, Ph.D., IBM Corporation
an international community with scientists and professionals Hajime Takagi GIT Associates, Ltd., Japan
from eight countries around the world. Fifty‐one authors,
William Tschudi, P.E., Lawrence Berkeley National Laboratory
from data center industry, R&D, and academia, plus fifteen
members at Technical Advisory Board have contributed to Kari Capone, John Wiley & Sons, Inc.
this book. Many suggestions and advice were received while
I prepared and organized the book. This book benefited from the following organizations and
I gratefully acknowledge the contributors who dedicated institutes:
their time in spite of their busy schedule and personal lives to
share their wisdom and valuable experience. 7 × 24 Exchange International
I would also like to thank the members at Technical Advisory American Society of Heating, Refrigerating, and Air
Board for their constructive recommendations on the structure Conditioning Engineers (ASHRAE)
of this handbook and thorough peer review of book chapters. Building Industry Consulting Service International
My thanks also go to Brett Kurzman, Alex Castro, Katrina (BICSI)
Maceda at Wiley and F. Pascal Raj at SPi Global whose can
Datacenter Dynamics
do spirit and teamwork were instrumental in producing this
book. European Commission Code of Conduct
Thanks and appreciation must go to the following indi- The Green Grid
viduals for their advice, support, and contributions: Japan Data Center Council
Open Compute Project
Sam Gelpi, Hewlett‐Packard Company
Silicon Valley Leadership Group
Dongmei Huang, Ph.D., Rainspur Technology, China
Telecommunications Industry Association (TIA)
Madhu Iyengar, Ph.D., Facebook, Inc.
Uptime Institute/451 Research
Jonathan Jew, J&M Consultants
U.S. Department of Commerce, National Institute of
Jonathan Koomey, Ph.D., Stanford University
Standards and Technology
Tomoo Misaki, Nomura Research Institute, Ltd., Japan
U.S. Department of Energy, Lawrence Berkeley National
Veerendra Mulay, Ph.D., Facebook, Inc. Laboratory
Jay Park, P.E., Facebook, Inc. U.S. Department of Energy, Oak Ridge National Laboratory

xxvii
xxviii Data Center Handbook (First Edition, 2015)

U.S. Department of Energy, Office of Energy Efficiency & U.S. Green Building Council, Leadership in Energy &
Renewable Energy Environmental Design
U.S. Department of Homeland Security, Federal
Emergency Management Administration My special thanks to my wife, Limei, my daughters, Amy
U.S. Environmental Protection Agency, ENERGY STAR and Julie, and grandchildren for their understanding, support,
Program and encouragement when I was preparing this book.
TABLE OF CONTENTS

PART I DATA CENTER OVERVIEW AND STRATEGIC PLANNING

1 Sustainable Data Center: Strategic Planning, Design, Construction,


and Operations with Emerging Technologies 1
Hwaiyu Geng
1.1 Introduction 1
1.2 Advanced Technologies 2
1.3 Data Center System and Infrastructure Architecture 6
1.4 Strategic Planning 6
1.5 Design and Construction Considerations 8
1.6 Operations Technology and Management 9
1.7 Business Continuity and Disaster Recovery 10
1.8 Workforce Development and Certification 11
1.9 Global Warming and Sustainability 11
1.10 Conclusions 12
References 12
Further Reading 13

2 Global Data Center Energy Demand and Strategies to Conserve Energy 15


Nuoa Lei and Eric R. Masanet
2.1 Introduction 15
2.2 Approaches for Modeling Data Center Energy Use 16
2.3 Global Data Center Energy Use: Past and Present 17
2.4 Global Data Center Energy Use: Forward-Looking Analysis 19
2.5 Data Centers and Climate Change 21
2.6 Opportunities for Reducing Energy Use 21
2.7 Conclusions 24
References24
Further Reading 26

3 Energy and Sustainability in Data Centers 27


Bill Kosik
3.1 Introduction 27
3.2 Modularity in Data Centers 32
xxix
xxx CONTENTS

3.3 Cooling a Flexible Facility 33


3.4 Proper Operating Temperature and Humidity 35
3.5 Avoiding Common Planning Errors 37
3.6 Design Concepts for Data Center Cooling Systems 40
3.7 Building Envelope and Energy Use 42
3.8 Air Management and Containment Strategies 44
3.9 Electrical System Efficiency 46
3.10 Energy Use of IT Equipment 48
3.11 Server Virtualization 50
3.12 Interdependency of Supply Air Temperature and ITE Energy Use 51
3.13 IT and Facilities Working Together to Reduce Energy Use 52
3.14 Data Center Facilities Must Be Dynamic and Adaptable 53
3.15 Server Technology and Steady Increase of Efficiency 53
3.16 Data Collection and Analysis for Assessments 54
3.17 Private Industry and Government Energy Efficiency Programs 55
3.18 Strategies for Operations Optimization 59
3.19 Utility Customer‐Funded Programs 60
References62
Further Reading 62

4 Hosting or Colocation Data Centers 65


Chris Crosby and Chris Curtis
4.1 Introduction 65
4.2 Hosting 65
4.3 Colocation (Wholesale) 66
4.4 Types of Data Centers 66
4.5 Scaling Data Centers 72
4.6 Selecting and Evaluating DC Hosting and Wholesale Providers 72
4.7 Build Versus Buy 72
4.8 Future Trends 74
4.9 Conclusion 74
References75
Further Reading 75

5 Cloud and Edge Computing 77


Jan Wiersma
5.1 Introduction to Cloud and Edge Computing 77
5.2 IT Stack 78
5.3 Cloud Computing 79
5.4 Edge Computing 84
5.5 Future Trends 86
References87
Further Reading 87

6 Data Center Financial Analysis, ROI, and TCO 89


Liam Newcombe
6.1 Introduction to Financial Analysis, Return on Investment,
and Total Cost of Ownership 89
6.2 Financial Measures of Cost and Return 97
6.3 Complications and Common Problems 104
CONTENTS xxxi

6.4 A Realistic Example 114


6.5 Choosing to Build, Reinvest, Lease, or Rent 124
Further Reading 126

7 Managing Data Center Risk 127


Beth Whitehead, Robert Tozer, David Cameron and Sophia Flucker
7.1 Introduction 127
7.2 Background 127
7.3 Reflection: The Business Case 129
7.4 Knowledge Transfer 1 131
7.5 Theory: The Design Phase 131
7.6 Knowledge Transfer 2 136
7.7 Practice: The Build Phase 136
7.8 Knowledge Transfer 3: Practical Completion 137
7.9 Experience: Operation 138
7.10 Knowledge Transfer 4 140
7.11 Conclusions 140
References 141

PART II DATA CENTER TECHNOLOGIES

8 Software‐Defined Environments 143


Chung‐Sheng Li and Hubertus Franke
8.1 Introduction 143
8.2 Software‐Defined Environments Architecture 144
8.3 Software‐Defined Environments Framework 145
8.4 Continuous Assurance on Resiliency 149
8.5 Composable/Disaggregated Datacenter Architecture 150
8.6 Summary 151
References 152

9 Computing, Storage, and Networking Resource Management


in Data Centers 155
Ronghui Cao, Zhuo Tang, Kenli Li and Keqin Li
9.1 Introduction 155
9.2 Resource Virtualization and Resource Management 155
9.3 Cloud Platform 157
9.4 Progress from Single‐Cloud to Multi‐Cloud 159
9.5 Resource Management Architecture in Large‐Scale Clusters 160
9.6 Conclusions 162
References162

10 Wireless Sensor Networks to Improve Energy Efficiency


in Data Centers 163
Levente Klein, Sergio Bermudez, Fernando Marianno and Hendrik Hamann
10.1 Introduction 163
10.2 Wireless Sensor Networks 164
10.3 Sensors and Actuators 165
10.4 Sensor Analytics 166
10.5 Energy Savings 169
xxxii CONTENTS

10.6 Control Systems 170


10.7 Quantifiable Energy Savings Potential 172
10.8 Conclusions 174
References 174

11 ASHRAE Standards and Practices for Data Centers 175


Robert E. Mcfarlane
11.1 Introduction: ASHRAE and Technical Committee TC 9.9 175
11.2 The Groundbreaking ASHRAE “Thermal Guidelines” 175
11.3 The Thermal Guidelines Change in Humidity Control 177
11.4 A New Understanding of Humidity and Static Discharge 178
11.5 High Humidity and Pollution 178
11.6 The ASHRAE “Datacom Series” 179
11.7 The ASHRAE Handbook and TC 9.9 Website 187
11.8 ASHRAE Standards and Codes 187
11.9 ANSI/ASHRAE Standard 90.1‐2010 and Its Concerns 188
11.10 The Development of ANSI/ASHRAE Standard 90.4 188
11.11 Summary of ANSI/ASHRAE Standard 90.4 189
11.12 ASHRAE Breadth and The ASHRAE Journal 190
References190
Further Reading 191

12 Data Center Telecommunications Cabling and TIA Standards 193


Alexander Jew
12.1 Why Use Data Center Telecommunications Cabling Standards 193
12.2 Telecommunications Cabling Standards Organizations 194
12.3 Data Center Telecommunications Cabling Infrastructure
Standards 195
12.4 Telecommunications Spaces and Requirements 196
12.5 Structured Cabling Topology 200
12.6 Cable Types and Maximum Cable Lengths 201
12.7 Cabinet and Rack Placement (Hot Aisles and Cold Aisles) 205
12.8 Cabling and Energy Efficiency 206
12.9 Cable Pathways 208
12.10 Cabinets and Racks 208
12.11 Patch Panels and Cable Management 208
12.12 Reliability Ratings and Cabling 209
12.13 Conclusion and Trends 209
Further Reading 210

13 Air‐Side Economizer Technologies 211


Nicholas H. Des Champs, Keith Dunnavant and Mark Fisher
13.1 Introduction 211
13.2 Using Properties of Ambient Air to Cool a Data Center 212
13.3 Economizer Thermodynamic Process and Schematic
of Equipment Layout 213
13.4 Comparative Potential Energy Savings and Required Trim
Mechanical Refrigeration 221
13.5 Conventional Means for Cooling Datacom Facilities 224
13.6 A Note on Legionnaires’ Disease 224
References225
Further Reading 225
CONTENTS xxxiii

14 Rack‐Level Cooling and Server‐Level Cooling 227


Dongmei Huang, Chao Yang and Bang Li
14.1 Introduction 227
14.2 Rack‐Level Cooling 228
14.3 Server‐Level Cooling 234
14.4 Conclusions and Future Trends 236
Acknowledgement237
Further Reading 237

15 Corrosion and Contamination Control for Mission Critical Facilities 239


Christopher O. Muller
15.1 Introduction 239
15.2 Data Center Environmental Assessment 240
15.3 Guidelines and Limits for Gaseous Contaminants 241
15.4 Air Cleaning Technologies 242
15.5 Contamination Control for Data Centers 243
15.6 Testing for Filtration Effectiveness and Filter Life 248
15.7 Design/Application of Data Center Air Cleaning 249
15.8 Summary and Conclusion 252
15.9 Appendix 1: Additional Data Center Services 252
15.10 Appendix 2: Data Center History 253
15.11 Appendix 3: Reactivity Monitoring Data Examples: Sample Corrosion
Monitoring Report 256
15.12 Appendix 4: Data Center Case Study 260
Further Reading 261

16 Rack PDU for Green Data Centers 263


Ching‐I Hsu and Ligong Zhou
16.1 Introduction 263
16.2 Fundamentals and Principles 264
16.3 Elements of the System 271
16.4 Considerations for Planning and Selecting Rack PDUs 280
16.5 Future Trends for Rack PDUs 287
Further Reading 289

17 Fiber Cabling Fundamentals, Installation, and Maintenance 291


Robert Reid
17.1 Historical Perspective and The “Structured Cabling Model”
for Fiber Cabling 291
17.2 Development of Fiber Transport Services (FTS) by IBM 292
17.3 Architecture Standards 294
17.4 Definition of Channel vs. Link 298
17.5 Network/Cabling Elements 300
17.6 Planning for Fiber‐Optic Networks 304
17.7 Link Power Budgets and Application Standards 309
17.8 Link Commissioning 312
17.9 Troubleshooting, Remediation, and Operational Considerations
for the Fiber Cable Plant 316
17.10 Conclusion 321
Reference 321
Further Reading 321
xxxiv CONTENTS

18 Design of Energy-Efficient IT Equipment 323


Chang-Hsin Geng
18.1 Introduction 323
18.2 Energy-Efficient Equipment 324
18.3 High-Efficient Compute Server Cluster 324
18.4 Process to Design Energy-Efficient Servers 331
18.5 Conclusion 335
Acknowledgement336
References336
Further Reading 336

19 Energy‐Saving Technologies of Servers in Data Centers 337


Weiwei Lin, Wentai Wu and Keqin Li
19.1 Introduction 337
19.2 Energy Consumption Modeling of Servers in Data Centers 338
19.3 Energy‐Saving Technologies of Servers 341
19.4 Conclusions 347
Acknowledgments347
References347

20 Cybersecurity and Data Centers 349


Robert Hunter and Joseph Weiss
20.1 Introduction 349
20.2 Background of OT Connectivity in Data Centers 349
20.3 Vulnerabilities and Threats to OT Systems 350
20.4 Legislation Covering OT System Security 352
20.5 Cyber Incidents Involving Data Center OT Systems 353
20.6 Cyberattacks Targeting OT Systems 354
20.7 Protecting OT Systems from Cyber Compromise 355
20.8 Conclusion 357
References 358

21 Consideration of Microgrids for Data Centers 359


Richard T. Stuebi
21.1 Introduction 359
21.2 Description of Microgrids 360
21.3 Considering Microgrids for Data Centers 362
21.4 U.S. Microgrid Market 364
21.5 Concluding Remarks 365
References365
Further Reading 365

PART III DATA CENTER DESIGN & CONSTRUCTION

22 Data Center Site Search and Selection 367


Ken Baudry
22.1 Introduction 367
22.2 Site Searches Versus Facility Searches 367
22.3 Globalization and the Speed of Light 368
22.4 The Site Selection Process 370
22.5 Industry Trends Affecting Site Selection 379
CONTENTS xxxv

Acknowledgment380
Reference380
Further Reading 380

23 Architecture: Data Center Rack Floor Plan and Facility Layout Design 381
Phil Isaak
23.1 Introduction 381
23.2 Fiber Optic Network Design 381
23.3 Overview of Rack and Cabinet Design 386
23.4 Space and Power Design Criteria 389
23.5 Pathways 390
23.6 Coordination with Other Systems 392
23.7 Computer Room Design 395
23.8 Scalable Design 398
23.9 CFD Modeling 400
23.10 Data Center Space Planning 400
23.11 Conclusion 402
Further Reading 402

24 Mechanical Design in Data Centers 403


Robert Mcfarlane and John Weale
24.1 Introduction 403
24.2 Key Design Criteria 403
24.3 Mechanical Design Process 407
24.4 Data Center Considerations in Selecting Key Components 424
24.5 Primary Design Options 429
24.6 Current Best Practices 436
24.7 Future Trends 438
Acknowledgment440
Reference440
Further Reading 440

25 Data Center Electrical Design 441


Malik Megdiche, Jay Park and Sarah Hanna
25.1 Introduction 441
25.2 Design Inputs 441
25.3 Architecture Resilience 443
25.4 Electrical Design Challenges 450
25.5 Facebook, Inc. Electrical Design 477
Further Reading 481

26 Electrical: Uninterruptible Power Supply System 483


Chris Loeffler and Ed Spears
26.1 Introduction 483
26.2 Principal of UPS and Application 484
26.3 Considerations in Selecting UPS 498
26.4 Reliability and Redundancy 502
26.5 Alternate Energy Sources: AC and DC 513
26.6 UPS Preventive Maintenance Requirements 515
26.7 UPS Management and Control 517
26.8 Conclusion and Trends 520
Further Reading 520
xxxvi CONTENTS

27 Structural Design in Data Centers: Natural Disaster Resilience 521


David Bonneville and Robert Pekelnicky
27.1 Introduction 521
27.2 Building Design Considerations 523
27.3 Earthquakes 524
27.4 Hurricanes, Tornadoes, and Other Windstorms 527
27.5 Snow and Rain 528
27.6 Flood and Tsunami 529
27.7 Comprehensive Resiliency Strategies 530
References532

28 Fire Protection and Life Safety Design in Data Centers 533


Sean S. Donohue, Mark Suski and Christopher Chen
28.1 Fire Protection Fundamentals 533
28.2 AHJs, Codes, and Standards 534
28.3 Local Authorities, National Codes, and Standards 534
28.4 Life Safety 535
28.5 Passive Fire Protection 537
28.6 Active Fire Protection and Suppression 537
28.7 Detection, Alarm, and Signaling 546
28.8 Fire Protection Design & Conclusion 549
References549

29 Reliability Engineering for Data Center Infrastructures 551


Malik Megdiche
29.1 Introduction 551
29.2 Dependability Theory 552
29.3 System Dysfunctional Analysis 558
29.4 Application To Data Center Dependability 569
Further Reading 578

30 Computational Fluid Dynamics for Data Centers 579


Mark Seymour
30.1 Introduction 579
30.2 Fundamentals of CFD 580
30.3 Applications of CFD for Data Centers 588
30.4 Modeling the Data Center 592
30.5 Potential Additional Benefits of a CFD-Based Digital Twin 607
30.6 The Future of CFD-Based Digital Twins 608
References609

31 Data Center Project Management 611


Skyler Holloway
31.1 Introduction 611
31.2 Project Kickoff Planning 611
31.3 Prepare Project Scope of Work 611
31.4 Organize Project Team 612
31.5 Project Schedule 613
31.6 Project Costs 615
31.7 Project Monitoring and Reporting 616
31.8 Project Closeout 616
31.9 Conclusion 616
Further Reading 616
CONTENTS xxxvii

PART IV DATA CENTER OPERATIONS MANAGEMENT

32 Data Center Benchmark Metrics 617


Bill Kosik
32.1 Introduction 617
32.2 The Green Grid’s PUE: A Useful Metric 617
32.3 Metrics for Expressing Partial Energy Use 618
32.4 Applying PUE in the Real World 619
32.5 Metrics Used in Data Center Assessments 620
32.6 The Green Grids XUE Metrics 620
32.7 RCI and RTI 621
32.8 Additional Industry Metrics and Standards 621
32.9 European Commission Code of Conduct 624
32.10 Conclusion 624
Further Reading 624

33 Data Center Infrastructure Management 627


Dongmei Huang
33.1 What Is Data Center Infrastructure Management 627
33.2 Triggers for DCIM Acquisition and Deployment 629
33.3 What Are Modules of a DCIM Solution 631
33.4 The DCIM System Itself: What to Expect and Plan for 636
33.5 Critical Success Factors When Implementing a DCIM System 639
33.6 DCIM and Digital Twin 641
33.7 Future Trends in DCIM 642
33.8 Conclusion 643
Acknowledgment643
Further Reading 643

34 Data Center Air Management 645


Robert Tozer and Sophia Flucker
34.1 Introduction 645
34.2 Cooling Delivery 645
34.3 Metrics 648
34.4 Air Containment and Its Impact on Air Performance 651
34.5 Improving Air Performance 652
34.6 Conclusion 656
References656

35 Energy Efficiency Assessment of Data Centers Using Measurement


and Management Technology 657
Hendrik Hamann, Fernando Marianno and Levente Klein
35.1 Introduction 657
35.2 Energy Consumption Trends in Data Centers 657
35.3 Cooling Infrastructure in a Data Center 658
35.4 Cooling Energy Efficiency Improvements 659
35.5 Measurement and Management Technology (MMT) 660
35.6 MMT‐Based Best Practices 661
35.7 Measurement and Metrics 662
35.8 Conclusions 667
References668
xxxviii CONTENTS

36 Drive Data Center Management and Build Better AI with


IT Devices As Sensors 669
Ajay Garg and Dror Shenkar
36.1 Introduction 669
36.2 Current Situation of Data Center Management 669
36.3 AI Introduced in Data Center Management 670
36.4 Capabilities of IT Devices Used for Data Center Management 670
36.5 Usage Models 670
36.6 Summary and Future Perspectives 673
Further Reading 673

37 Preparing Data Centers for Natural Disasters and Pandemics 675


Hwaiyu Geng and Masatoshi Kajimoto
37.1 Introduction 675
37.2 Design for Business Continuity and Disaster Recovery 675
37.3 Natural Disasters 676
37.4 The 2011 Great East Japan Earthquake 676
37.5 The 2012 Eastern U.S. Coast Superstorm Sandy 679
37.6 The 2019 Coronavirus Disease (COVID-19) Pandemic 683
37.7 Conclusions 683
References684
Further Reading 684

INDEX687
PART I

DATA CENTER OVERVIEW AND STRATEGIC PLANNING


1
SUSTAINABLE DATA CENTER: STRATEGIC PLANNING,
DESIGN, CONSTRUCTION, AND OPERATIONS
WITH EMERGING TECHNOLOGIES

Hwaiyu Geng
Amica Research, Palo Alto, California, United States of America

1.1 INTRODUCTION u­ rbanization are enormous. Demands for infrastruc-


ture, jobs, and services must be met. Problems of
The earliest known use of the term “megatrend” was in human health, crime, and pollution of the environment
1980s published in the Christian Science Monitor (Boston). must be solved.
Oxford dictionary defines megatrend as “An important Demographic trend: Longer life expectancy and lower
shift in the progress of a society.” Internet searches reveal ­fertility rate are leading to rapidly aging populations.
many megatrend reports that were published by major con- We must deal with increasing population, food and
sulting firms including Accenture, Frost, KPMG, McKinsey water shortages, and preserving natural resources. At
Global Institute, PwC, etc. as well as organizations such as the same time, sex discrimination, race and wealth ine-
UN (United Nations)* and OECD (Organization for qualities in every part of the world must be dealt with.
Economic Co‐operation and Development [1]). One can Technological changes: New technologies create both
quickly summarize key mega­trends reported that include challenges and opportunities. Technological break-
globalization, urbanization, demographic trend, technolog- throughs include Internet of Things (IoT), cyber–­
ical breakthroughs, and c­limate changes. physical systems (CPS), data analytics, artificial
intelligence (AI), robotics, autonomous vehicles (AVs)
Globalization: From Asia to Africa, multinational corpora- (robots, drones), cloud and edge computing, and many
tions are expanding their manufacturing and R&D at a other emerging technologies that fuel more innovative
faster pace and on a larger scale than ever before. applications. These technologies fundamentally change
Globalization widely spreads knowledge, technologies, our lifestyle and its ecosystem. Industries may be dis-
and modern business practices at a faster space that facil- rupted, but more inventions and innovations are nurturing.
itate international cooperation. Goods and services inputs Climate change and sustainability: Unusual patterns of
are increasingly made of countries from emerging econo- droughts, floods, and hurricanes are already happening.
mies who join key global players. Global value chains The world is experiencing the impacts of climate change,
focus on national innovation capacities and enhance from melting glaciers to rising sea level to extreme
national industrial specialization. Standardization, com- weather patterns. In the April 17, 2020, Science maga-
patibility, and harmonization are even more important in zine issue, researchers examine tree rings and report that
a global interlaced environment. the drought from 2000 to 2018 in the southwestern of
Urbanization: Today, more than half of the world’s popu- North America is among the worst “megadroughts” that
lation live in urban areas, and more people are moving have stricken the region in the last 1,200 years. The
to the urban areas every day. The impacts from United Nation’s IPCC (Intergovernmental Panel on
*
https://www.un.org/development/desa/publications/wp-content/uploads/
Climate Change) reports have described increasing
sites/10/2020/09/20-124-UNEN-75Report-2-1.pdf ­dangers of climate change. At the current rising rate of

Data Center Handbook: Plan, Design, Build, and Operations of a Smart Data Center, Second Edition. Edited by Hwaiyu Geng.
© 2021 John Wiley & Sons, Inc. Published 2021 by John Wiley & Sons, Inc.

1
2 SUSTAINABLE DATA CENTER: STRATEGIC PLANNING, DESIGN, CONSTRUCTION, AND OPERATIONS

greenhouse gas emissions, the global average tempera- 1.1.2 Data Center Energy Consumption Trends
ture will rise by more than 3°C in the twenty‐first
The energy consumption trend depends on a combination of
­century. Rising temperatures must be kept below 2°C
factors including data traffic, emerging technologies, ICT
before year 2050 or potential irreversible environmental
equipment, and energy demand by infrastructure in data
changes will occur. It is imperative to find sustainable
centers. The trend is a complicated and dynamic model.
solutions and delay climate change.
According to “United States Data Center Energy Usage
Report, Lawrence Berkeley National Laboratory” (2016) by
This chapter will start with megatrends and emerging
Arman Shehabi, Jonathan Koomey, et al. [2], U.S. data
technologies that provide insightful roadmap of future data
center electricity used by servers, storage, network equip-
centers and essential elements to be included when design-
ment, and infrastructure in 2014 consumed an estimated of
ing and implementing a data center project.
70 billion kWh. That represents about 1.8% of total U.S.
electricity consumption. The U.S. electricity used by data
1.1.1 Data Center Definition centers in 2016 was 2% of global electricity. For
70 billion kWh, it is equivalent to 8 nuclear reactors with
Data centers are being used to orchestrate every aspect of 1,000 MW baseload each. 70 billion kWh provides enough
our life that covers food, clothing, shelter, transportation, energy for use by 5.9 million homes in 1 year.2 It is equiva-
healthcare, social activities, etc. The U.S. Environmental lent to 50 million ton of carbon dioxide emission to the
Protection Agency defines a data center as: atmosphere. It is expected that electricity consumption will
continue to increase and data centers must be valiantly
• “Primarily electronic equipment used for data process- ­controlled to conserve energy use.
ing (servers), data storage (storage equipment), and
communications (network equipment). Collectively,
this equipment processes, stores, and transmits digital 1.2 ADVANCED TECHNOLOGIES
information.”
• “Specialized power conversion and backup equipment The United Nations predicts that the world’s population of
to maintain reliable, high‐quality power, as well as 7.8 billion people in 2020 will reach 8.5 billion in 2030 and
environmental control equipment to maintain the 9.7 billion in 2050.3 Over 50% of the world’s population are
proper temperature and humidity for the ICT (infor- Internet users that demand more uses of data centers. This
mation and communication technologies) section will discuss some of the important emerging tech-
equipment.” nologies illustrated by its anatomy, ecosystem, and taxon-
omy. Anatomy defines components of a technology.
A data center could also be called data hall, data farm, data Ecosystem describes who uses the technology. Taxonomy is
warehouse, AI lab, R&D software lab, high‐performance to classify the components of a technology and their provid-
computing lab, hosting facility, colocation, computer room, ers in different groups. With a good understanding of what is
server room, etc. anatomy, ecosystem, and taxonomy of a technology, one can
An exascale data center has computing systems that per- effectively apply and master the technology.
form calculation over a petaflop (a million trillion floating‐
point) operations. Exascale data centers are elastically
1.2.1 Internet of Things
configured and deployed that can meet specific workloads
and be optimized for future developments in power and The first industrial revolution (IR) started with the invention
cooling technology.1 of mechanical powers. The second IR happened with the
The size of a data center could range from a small closet invention of assembly line and electrical power. The third IR
to a hyperscale data center. The term hyperscale refers to a came about with computers and automation. The fourth IR
resilient and robust computer architecture that has the ability took place around 2014 as a result of the invention of IoT.
to increase computing ability in memory, networking, and IDC (International Data Corporation) forecasts an expected
storage resources. IoT market size of $1.1 trillion in 2023. By 2025, there will
Regardless of size and what it is called, all data centers be 41.6 billion IoT connected devices that will generate
perform one thing, that is, to process and deliver information. 79.4 zettabytes (ZB) of data.

2
https://eta.lbl.gov/publications/united-states-data-center-energy
1
http://www.hp.com/hpinfo/newsroom/press_kits/2008/cloudresearch/fs_ 3
https://population.un.org/wpp/Graphs/1_Demographic%20Profiles/
exascaledatacenter.pdf World.pdf
1.2 ADVANCED TECHNOLOGIES 3

The IoT is a series of hardware coupling with software 1.2.1.2 Ecosystem


and protocols to collect, analyze, and distribute information.
There are consumer‐, government‐, and enterprise‐facing
Using the human body as an analogy, humans have five basic
customers within an IoT’s ecosystem (Fig. 1.1). Each IoT
senses or sensors that collect information. Nervous system
platform contains applications that are protected by a cyber-
acts as a network that distributes information. And the brain
security system. Consumer‐facing customers be composed
is accountable for storing, analyzing, and giving direction
of smart home, smart entertainment, smart health, etc.
through the nervous system to five senses to execute deci-
Government‐facing customers are composed of smart cities,
sion. The IoT works similar to the combination of five
smart transportation, smart grid, etc. Enterprise‐facing cus-
senses, the nervous ­system and the brain.
tomers include smart retail, smart manufacturing, smart
finance, etc.
1.2.1.1 Anatomy
Anatomy of the IoT comprises of all components in the fol- 1.2.1.3 Taxonomy
lowing formula:
Using taxonomy in a hospital as an analogy, a hospital has
an admission office, medical record office, internal medi-
Internet of Things Things sensors/cameras/actuators cine, cardiology, neurology, radiology, medical labora-
edge / fog computing and AI tory, therapeutic services, pharmacy, nursing, dietary, etc.
Wi-Fi / gateway / 5G / Internet IoT’s taxonomy encompasses suppliers who provide
cloud computing / data analytics / AI products, equipment, or services that cover sensors
insight presentations / actions (microprocessor unit, system on chip, etc.), 5G, servers,
storage, network, security, data analytics, AI services,
industry solutions, etc.
Each “Thing” has a unique IPv4 or IPv6 address. A The Industrial IoT (IIoT) and CPS connect with many
“Thing” could be a person, an animal, an AV, or alike that smaller IoTs. They are far more complicated in design and
is interconnected at many other “Things.” With increasing applications than consumer‐facing IoTs.
miniaturization and built‐in AI logics, sensors are per-
forming more computing at “edge” as well as other com-
1.2.2 Big Data Analytics and Artificial Intelligence
ponents in the IoT’s value chain before arriving at data
centers for “cloud computing.” AI is embedded in every Data analytics is one of the most important components in
component and becomes an integral part of the IoT. This IoT’s value chain. Big data in size and complexity, structured,
handbook considers Artificial Intelligence of Things semi-structured, and unstructured, outstrips the abilities to be
(AIoT) the same as the IoT. processed by traditional data management systems.

Users
Consumers
Internet of Things ecosystem Smart home system
Professional services Smart security
Security Smart entertainment
Smart healthcare…
Modules/ Connectivity Platforms Applications Governments
devices
Smart cities
Analytics
Smart transportation
Smart energy
Smart grid…
Consumer Government Enterprise
Vehicles Emergency services Customers
Enterprises
Shopping Environmental Value chain Smart retail
Health Utilities/energy Manufacturing Smart finance
Fitness Traffic management Transport Smart manufacturing
Home Intelligent surveillance Services
Smart agriculture…
Entertainment Public transport Automation/robotics
5

FIGURE 1.1 Internet of Things ecosystem. Source: IDC, Amica Research


Another random document with
no related content on Scribd:
CHAPTER IV.
Adventures in the course of my profligate Career.—Motives which induce me to
marry my Companion.—Her exemplary Behaviour.—A family Misfortune.

Having now settled myself in a manner much to my satisfaction,


and happily met with a faithful friend, to whom I might confide my
most secret thoughts, who would sincerely participate my joy, when
success crowned my pursuits; and who, in the hour of adversity,
would condole with, and cherish me, I applied myself with redoubled
assiduity to the acquirement of money, with a full resolution in the
event of my meeting with one good booty, or realizing by degrees a
sufficient sum to quit the hazardous course of life I had embarked in,
to establish myself in some honest line of business. To this prudent
measure I was also strongly prompted by my companion, who could
not hide her fears and anxiety on my account, and was never easy
during my absence from home on a depredatory excursion. I
continued to visit the shops as usual in the morning, and the theatres
in the evening with tolerable success; and my partner having
expressed a desire to accompany me, in the hope of rendering me
service, I was induced to gratify her. As her figure and address were
both extremely prepossessing, and her air perfectly genteel, I soon
found her eminently useful; for she not only received from me the
property I purloined, but with much ingenuity would contrive to
engross the attention of the shopkeeper while I robbed his counter,
or by artful gallanting with a gentleman at a public place, facilitate my
design upon his pockets. At all times, when disengaged from these
hazardous practices, we lived a life of perfect domestic happiness,
our chiefest pleasure being centred in each other’s company.
As our mutual affection increased, my companion, whom I had
informed of the outlines of my past life, and who was aware of the
dangers to which I was daily exposed, being filled with tender fears
of losing me for ever, and prompted by sincere affection, suggested
the idea of uniting ourselves indissolubly by marriage; in the hope
that should I unhappily experience a reverse of fortune, and be again
banished from my native country, she might obtain permission to
share my misery, and contribute, by her society, to lessen my
sufferings. This proposal so fully convinced me of her undisguised
attachment, and had so much reason on its side, that I gave into it
with ardent pleasure; and the necessary preliminaries being
adjusted, we were accordingly married at St. Paul’s, Covent-Garden,
on the 21st of July, 1808, her mother, to whom she had become
reconciled, and who (judging by appearances,) had a favourable
opinion of the match, assisting at the ceremony.
Soon afterwards, I communicated the event to my mother,
informing her that weighty reasons had rendered it necessary to
observe privacy on the occasion; and hinting to the unsuspecting old
woman, that I had acquired by this marriage, a considerable
pecuniary advantage. This intimation gave my mother great
pleasure, and I took care by increased liberality towards her and my
sisters, to confirm them in the opinion of my veracity. The behaviour
of my wife became every day more exemplary; and had I been free
from that remorse which must ever accompany a guilty life, and
enabled to procure those necessary comforts which I knew so well
how to enjoy, by upright means, I should have considered myself
supremely happy. In the beginning of the month of October, my wife,
who was far advanced in her pregnancy, accompanied me one
evening to Drury-lane theatre; and the performance being over, we
were descending the stair-case from the box-lobby, when I
attempted to possess myself of a gentleman’s pocket-book; but by
some accident he suspected my design, and publicly accused me
therewith. Unfortunately several other gentlemen, who had been
robbed in the course of the evening, being on the spot, and
beginning to compare notes, agreed unanimously that they
recollected my person as being near them about the time they were
robbed, and did not scruple to insinuate that I ought to be detained
and searched. This conversation naturally attracted the attention of
the company immediately round us; but while it took place, all the
parties were obliged by the pressure of the throng behind to continue
descending, and we in fact quitted the theatre all together. Being
arrived in Little Russell-street, the gentlemen surrounded me to the
number of about a score, and our altercation became loud and
vehement. Fortunately for me no police-officers happened to be near
the spot; for although I had nothing to fear from a search, yet the
circumstance would have made me personally known to the latter,
and would of course operate to my disadvantage on my future
appearance at the theatre. I exerted every art of expostulation, and
finally had recourse, on my part, to threats, affecting to feel highly
insulted by their insolent insinuations; declared myself a gentleman
of character, which I would prove to their cost; offered to give my
card of address, or to retire to a coffee-house, and send for
respectable persons who knew me, but all my rhetoric proved
ineffectual; some were for giving me in charge to an officer; others
still more violent were for having me pumped. At this moment a
person named G—ge W—k—n, now in this colony, who had been
himself exercising his vocation in the pit of the theatre, happened
fortunately to come up, and seeing a crowd collected, stopped to
ascertain the cause. He immediately perceived the critical situation
in which I stood, and having the appearance of a man of fashion, he
stepped forward, and hearing the various motions of my persecutors,
strongly advised them to forbearance, and caution how they treated
a gentleman, as I evidently appeared to be; urging that they must
certainly be mistaken in their conjectures, that my proposal of giving
my address, or a reference, ought to be sufficient, and particularly
dwelt on the impropriety of taking the law into their own hands.
These arguments of my friend W—k—n carried so much weight, that
the gentlemen began to waver and grow less clamorous; till at length
they dropped off one by one; and W—k—n, assuming a haughty
tone, said, taking me by the arm, “Come, Sir, you have been
sufficiently exposed, and long enough detained on a charge which I
am confident there is no foundation for; allow me to conduct you
from this spot; if you are going towards St. James’s, I shall be glad of
your company, and let me see (raising his voice and cane together,)
who will dare to insult you further.” So saying, he led me away in
triumph, tipping the wink to my poor wife, who had stood all the while
at a small distance, much terrified and agitated by various emotions,
which so much affected her, that though we lived within two hundred
yards of the theatre, she had scarcely power to walk home; and we
had no sooner quitted our kind conductor, who attended us to the
door, than she fainted away, and was for sometime insensible. The
consequences of this untoward event were still more seriously
afflicting, for her tender constitution was not proof against the shock,
and she was the next day prematurely delivered of a male child,
which, however, only lived eight hours, and was a subject of infinite
regret to us both.
CHAPTER V.
Adventure of the Silver Snuff-box.—Its Consequences.—My narrow Escape from
Transportation, which I have since had reason to regret.

Happening soon after the adventure at Drury-lane, to read an


advertisement, stating that a meeting of the freeholders of the county
of Middlesex would be convened on the 11th of November, at the
Mermaid Tavern, Hackney, to consider of the expediency of
petitioning the Throne on the subject of parliamentary reform, it
struck me that I might find it worth while to attend this meeting, as it
would probably attract a large concourse of people, and, as at such
assemblies riots and much confusion frequently occurred, which
afforded a favourable opportunity for plundering the pockets of the
company. On the day appointed, I accordingly left town in one of the
Hackney stages, and arriving at the Mermaid about one o’clock,
found the sheriffs had just opened the business of the meeting,
which was held in a large room commonly used as an assembly-
room for dancing, and detached from the tavern itself. To my
disappointment, however, there were not above three hundred
persons collected, and the building being very spacious, there was
not the least prospect of any violent pressure taking place. Before I
commenced my operations, I entered a small house called “The
Tap,” immediately contiguous to, but distinct from, the Mermaid; and
going into a parlour, called to the landlady, a decent looking elderly
woman, for a glass of brandy and water, and a pipe. Having taken
and paid for this refreshment, I proceeded to the meeting; and found,
so far from any tumult or uproar, that the whole company were
collected at one end of the room, and listening in profound silence to
the speech of some popular and patriotic orator, who was warmly
censuring the conduct of ministers, and advocating the cause of
liberty. I now entered the thickest part of the crowd, and having tried
the pockets of a great many persons without feeling a single pocket-
book, I at length extracted successively two snuff-boxes from
different gentlemen; but their coats being buttoned up, and the
pockets inside, I was obliged to use my scissors in cutting the bottom
of each pocket, before I could obtain the desired prizes. This trouble
and risk I should not have incurred had not I assured myself that the
boxes from their shape, &c.; were both silver; but to my mortification,
they proved on inspection, the one wood, and the other a sort of
japanned leather, though both perfectly genteel, and mounted with
silver: however, as they were of no intrinsic value to me, I threw them
away; and, although it was rather imprudent, I entered the room a
third time, in hopes of better success. I soon found myself standing
behind a well-dressed man, who was wrapped in deep attention to
the speaker, and perceived to my great joy that he had a small
leather pocket-book in his inside coat-pocket, and also a very fine
large snuff-box, evidently silver, from its shape and weight. I had
again recourse to my scissors, and having made an incision,
extracted the contents of the pocket, with which I hastily retired: but I
was again partially disappointed, for I found that what I had taken for
a pocket-book, was in fact merely a pen and ink-case: the box,
however, was a very elegant one, and quite new. Although it
appeared that I was not destined to be very fortunate in this day’s
adventure, I determined to make one other trial; but as it would be
dangerous to keep the stolen box about me, and I saw no
convenient spot in which to conceal it, I adopted the following
method to dispose of it, while I made my final attempt in the
assembly-room. Going into the little tap-house before described, I
addressed the landlady, inquiring if she sold any snuff, or could
without inconvenience, procure me a little. She answered that she
had none, but would get me some in a very short time. I thanked her,
and replied that as I was anxious to hear the debates in the
assembly-room, she would oblige me by procuring an ounce of
rappee, for which purpose I handed her the box I had just obtained,
saying I would call for it in a quarter of an hour. Having now, as I
conceived, effectually and safely deposited my prize, I left the Tap
with an intention of re-entering the meeting-room; but suddenly
changing my mind, I determined to desist, having by the box alone
secured the expenses of my journey, and to return immediately
home. However, as I felt hungry, and saw no signs of
accommodation for eating in the Tap, I proceeded a little way up the
street, till I came to a sort of cook’s-shop, where I procured a lunch,
and then returned to reclaim my snuff-box from my obliging old
landlady, having been absent from her barely a quarter of an hour.
Going boldly up to the little bar in which she sat, I inquired if she had
procured me the snuff; she replied that she had, and turning round to
a cupboard behind her, produced the box, which I held out my hand
to receive; but, to my utter confusion, I was prevented by the
gentleman himself, from whom I had stolen it, who, starting from a
dark corner of the passage close to my elbow, where he had been
concealed, received the box in his hand, and turning to me, inquired
in a peremptory tone, if that was my snuff-box? I answered with a
smile, “No, Sir, it is a box that I found—if you have any claim to it, it
is much at your service.” He then inquired where I had found it; I
replied, that going to make water in a corner of the stable-yard, I
perceived something shine amongst some rubbish, which taking up,
I found to be the box in question; that I was myself in the habit of
taking snuff, and having that day left my own box at home, I thought
it a good opportunity of getting a supply; that I had therefore
commissioned the landlady to procure me some snuff, and left her
this box for that purpose. The gentleman rejoined, that he had been
robbed of the box in the assembly-room, and that having found it in
my possession, he felt it incumbent to detain me, on strong suspicion
of being the thief. All I could urge, and every art I tried, were
ineffectual to convince this rigid gentleman of my innocence, and
several others joining him, one of them asked my name and situation
in life. I answered, that when charged with so disgraceful an act as
that of picking pockets, I should certainly decline giving such
explanation; but that I should at a proper season, be enabled to
refute the accusation, and prove my respectability. To this the
inquirer replied, that although himself a justice of peace, he certainly
had no wish to extort, nor was I obliged to give any answers against
my inclination, and that upon the whole, he could not censure me for
preserving silence; however, as the property stolen had been traced
to me, it became his duty and that of the owner, to have me detained
till I gave an account of myself. A constable being called in, was now
desired to search me, which he proceeded to do, and the first thing
he found was a pair of small scissors without a sheath, in my
breeches-pocket, where I had in my hurry deposited them after
cutting out my last booty. The constable exhibited these with an air of
triumph, exclaiming to the by-standers, “See, gentlemen, here are
the tools the pocket was cut with!” He also took from me about fifty
shillings in loose money, a pocket-bock, card-case, pair of silver
spectacles, a two-bladed knife, silver pencil-case, tobacco-box,
handkerchief, gloves, &c., all my own property, and such as I usually
carried about me. I had left my watch at home, which, it being a
valuable one, I was frequently persuaded by my wife to do when I
went upon such excursions as the present. The meeting being by
this time dissolved, the loser of the box set off on his return to town,
and I was left in charge of two constables who were to follow with
me. In about an hour, a coach being obtained, I was conveyed to
Worship-street office for examination, where I arrived at six in the
evening, just as the magistrate had taken the chair. This worshipful
justice was Joseph Moser, esq., a gentleman of an eccentric
character, and the same, if I mistake not, whose name I have
frequently met with in print, as the author of many well-written and
humorous essays, &c., in periodical works. Being placed at the bar,
the prosecutor, who proved to be a Mr. Imeson, tobacconist, in
Holywell-lane, Shoreditch, made his appearance in the same coat he
had on in the morning, and exhibiting his pocket, through the bottom
of which he thrust his hand by way of demonstration. He stated, that
he was that day attending the meeting of freeholders at Hackney,
and while listening to the debates in the assembly-room, he had
occasion to take snuff; when putting his hand in his pocket, he found
the bottom of it cut, apparently with a sharp scissors, and not only
his snuff-box, but every other article taken out; that he was sure the
depredation was recent, as he had taken snuff but a few minutes
before, and had not since changed his position: that he staid to hear
the conclusion of the business, and on leaving the room, was
relating his loss to some gentlemen in the inn-yard, and that a little
boy happening to overhear him, stepped up and said, “Sir, my
mother has got a pretty snuff-box, that a gentleman gave her to put
some snuff in;” on which he was induced to accompany the child to
its parents, where, requesting to see the box, he found it to be his
own; that he had then taken the measures for my detection, which I
have above related. The landlady, Mrs. Andrews, was then sworn,
and stated my coming to her house, taking some refreshment, and
afterwards returning to inquire for snuff, leaving her the box, &c., all
which, she said was transacted in the most public manner; and, the
good woman voluntarily added, that she could never suppose I
should have acted as I had done, had I been the person who stole
the box. The officer who had searched me, now produced the
articles taken from my person, not forgetting to dwell upon the
circumstance of the open scissors, the sheath of which he found in
another pocket. The magistrate viewing these articles with attention,
observed, that he had no doubt of their being all stolen, and ordered
them to be advertised in the daily papers, and that I should be
brought up again on that day week, when it was probable the
persons who had lost such articles, would attend to identify them. As
to the present charge, he said the case was clear enough, and he
would, to save further trouble, bind over the parties to prosecute at
once. Then addressing me, his worship inquired my name, place of
abode, &c. I answered, that my name was James Hardy, but I must
beg to decline giving any further account of myself, as it appeared
his worship was determined to commit me for trial, and I should
therefore not trouble my friends until a future day. Mr. Moser now
remarked on some of the articles found upon me, inquiring with a
sarcastic grin, how long I had worn barnacles? As to the knife, he
said it was evidently a thief’s knife; and turning to Armstrong, one of
his officers, he asked him, if that was not such a blade as they used
for starring a glaze? The knife and scissors, his worship called my
working-tools. It was in vain I assured this facetious justice that these
things were my own lawful property, and offered to prove where I had
purchased them all: he insisted on detaining them, and was hardly
persuaded to return the money taken from me. I was then committed
to New Prison, Clerkenwell, to which I was conveyed about nine
o’clock at night. Arriving there, I desired to be accommodated
between-gates, and after paying the usual fees, &c., I was
conducted to a bed in the same room I had occupied on a like
occasion, in the year 1800. Having now leisure to reflect on the
occurrences of the day, I began to consider my situation hopeless
enough; the snuff-box having been traced to me, the circumstance of
the pocket being cut, the scissors found, &c., altogether furnished a
chain of evidence, too strong, I feared, to be overruled by my bare
assertion, that I had found the property; a defence the most flimsy,
but the most commonly resorted to. I, therefore, laid my account with
being transported at least. What heightened my present distress
was, that my poor wife would be grievously alarmed at my not
returning home this night; and it would be a difficult matter, even the
next day, to inform her of my situation, as I knew the officers were
intent upon discovering, if possible, my place of abode, in order to
ascertain my character, and mode of life. The morning being come, I
was fortunate enough to meet with an intimate acquaintance, by
whom I despatched a message to my wife, requiring her to visit me
immediately, and in an hour’s time, I had the pleasure of seeing her
appear. Her distress may be easily conceived. I comforted and
encouraged her as well as I could; and giving her a strict caution not
to suffer herself to be followed or watched in her return, desired she
would wait with patience, and hope for the approach of the session,
which would decide my fate. During the interval of my second
examination, I read the following advertisement inserted by the
officers of Worship-street:—“Stopped upon a suspicious person now
in custody, the undermentioned articles, supposed to be stolen; [here
they were all minutely described.] Any persons having lost such
goods, are desired to attend at this office on Friday next, when the
said person will be brought up for re-examination, &c.” On the 18th
of November, I was accordingly reconducted to Worship-street, my
wife being permitted to accompany me in the coach. Being again
brought before Mr. Moser, that gentleman inquired if any body was in
attendance to claim the property found on me; and being answered
in the negative, he expressed himself confident that claimants would
appear, but said he would, however, finally commit me to Newgate,
and, that the articles in question should be detained until the day of
my trial; when, if not owned before, the court would no doubt restore
them on my application; nor could all my asseverations or arguments
convince him of the property being my own, or induce him to alter his
decree respecting them. I was accordingly conducted to Newgate,
accompanied by my wife, whose uniform attention to me in this and
every other distress, proved the sincerity of her attachment.
As the session was to commence on the 30th, I had no time to
lose in preparing for my trial. I, therefore, drew up a brief for counsel,
in which I dwelt strongly on the open and public manner in which I
had acted with Mrs. Andrews; the improbability that I should have
taken so much trouble, had I been the thief who stole the box, full of
snuff, as the prosecutor described it to have been, and on every
other point which I thought might prove of moment, or afford the
counsel an opportunity of shewing his wit or ingenuity, but still
deceiving even him, by stoutly adhering to my first story of finding
the property. This brief I sent by my wife, with the usual fee, to Mr.
Knapp, a gentleman, of whose abilities I entertained a high opinion.
Notwithstanding all this, I had at the bottom, very little hopes of
escaping conviction; and persons best experienced in such matters,
who heard the circumstances, declared nothing but a miracle could
save me. I, however, concealed these unpleasing ideas from my
wife, and assured her that I felt confident of being acquitted. The
grand jury being met, I soon heard that a true bill had been returned
by them; and, on the following Wednesday, the court opening, I was
taken down for trial, but was not put to the bar until Friday the 2d of
December. Previous to my leaving the ward of the prison in which I
lodged, a fellow-prisoner, with whom I had become intimate, knowing
the circumstances of my case, and the nature of my intended
defence, had in a half-jocular manner, offered to lend me his snuff-
box, which he advised me to display to the court, and occasionally to
take a pinch from it during my trial; this he observed, would
strengthen my assertion that I was in the habit of using snuff, and
give a colour to my defence; and, he good-naturedly added, that he
hoped it would prove lucky to me. I thankfully accepted the proffered
favour, of which I did not fail to make use at the proper season.
Being arraigned at the bar, I stood capitally indicted for stealing a
silver snuff-box, value two pounds, the property of Thomas Imeson,
privily from his person. Mr. Imeson having given his evidence, my
counsel in cross-examining him said, “I take for granted, Sir, you
can’t take upon yourself to swear, whether you were robbed of your
snuff-box, or whether it fell through the hole in your pocket; all you
know is, that you found your pocket torn, and the box among other
articles missing?” Answer, “Certainly I cannot.” The landlady then
stated in a faltering voice, and evidently much embarrassed at being
examined before so large an assembly, the manner in which I had
applied to her, &c., and in answer to a question from Mr. Knapp,
said, that she could never suppose I should have acted in the open
manner I did, if I had stolen the box. The constable who searched
me was the next witness; and he having described that proceeding,
and produced the articles found upon me, the Recorder, who
presided on the bench, said, “I suppose, Mr. Bell, there were a great
variety of characters attending this meeting, which was held for the
purpose of obtaining parliamentary reform?”
Ans. “Certainly, my lord.”
Recorder. “No doubt there were many persons, freeholders as well
as not freeholders?”
Ans. “Yes, my lord.”
Recorder. “I dare say people of all descriptions, tag-rag, and
bobtail?”
Ans. “There might, my lord.”
I now began to entertain strong hopes, perceiving that the tide of
prejudice ran in my favour. I was dressed in a very genteel but
becoming manner, and had not the least appearance of a thief. I had
put on the most modest air and countenance I could assume, and I
thought the court and jury appeared to view me with favourable
eyes. I, therefore, took another pinch from my friend’s box, and
waited the event with patience, being prepared with a good defence,
when called upon to make it. But I was not put to that trouble; for the
Recorder addressing the jury, said, “Gentlemen, I must in this stage
of the trial, deliver it as my opinion, that I cannot see any grounds for
charging the prisoner with felony. Gentlemen, the accident of finding
a snuff-box might have happened to one of yourselves, to me, or to
any other honest man; and, it would be hard indeed if such an
accident should subject the finder to a prosecution for felony. If you
are of my opinion, it will be unnecessary to recapitulate the evidence,
or put the prisoner upon his defence.” His Lordship then paused, and
I leave the reader to imagine the state of suspense I was for some
moments in. The jury having whispered together, one of them stood
up and said, “My lord, we wish to ask a question of Mrs. Andrews,
namely, whether at the time the prisoner brought her the box, he
delivered it as his own, or said he had found it?” Mr. Knapp eagerly
catching at this question, desired Mrs Andrews to stand up, and said
to her, “Mrs. Andrews, the jury wish to ask you whether the young
man at the bar told you it was his own snuff-box, or whether he said
he had found it?” The poor simple woman, confused and trembling,
and not comprehending the drift or importance of the question,
answered in a low voice, “He said he had found it, gentlemen.” Mr.
Knapp having obtained this answer, with a smile, or rather laugh of
satisfaction, turned to the jury, repeating her words, “He said, he had
found it. I hope, Gentlemen, you are now satisfied.” He then folded
up my brief, and handed it to an officer of the court, to whom he
made a motion with his hand to return it to me. I received it with a
respectful bow of acknowledgment, and Mr. Knapp threw himself
back in his seat, and began playing with his watch-chain, as much as
to say, “the business is settled, I have successfully done my duty,
and saved my client;” and, so indeed he had, for the foreman
immediately pronounced the welcome verdict of “Not Guilty.” There
is one circumstance to which my acquittal on this occasion may be in
a great measure imputed; namely, that I was fortunately not known
by any of the turnkeys or officers of the court, who never fail when an
old face appears, to give a private intimation to the judge, if (which is
very rare) he should not himself recognise the party. I now applied to
the court for the articles taken from me, which the Recorder ordered
to be restored; but first expressed a wish to view them, saying to the
constable, “Let me look at those articles, Mr. Bell, there is nothing
remarkable in them I suppose.” The malicious constable answered,
“No, my lord, without it is the scissors.” The Recorder, having
minutely examined them, replied “I see nothing extraordinary in them
neither, Mr. Bell, except that they appear to be remarkable good
ones—poo, poo, let the young man have his property by all means:”
on which the fellow, evidently chagrined, delivered the whole into my
hands. As to the snuff-box, his Lordship observed, there could be no
doubt but it was the same which Mr. Imeson had lost, though he
could only speak to its identity, as being of the same pattern, having
bought it but a few days before the accident, and there being no
mark which he could know it by: he was, therefore, ordered to retain
it. I then bowed with gratitude to the court and jury, and with respect
to the auditors, and quitting the bar, had my irons knocked off, and
was received with open arms by my dear wife, who had been waiting
the issue in anxious suspense, accompanied by my friend Bromley.
We all three returned to the prison, where I had left some little
matters, and every one was astonished at my acquittal. I restored
the borrowed snuff-box to my kind friend, not forgetting to
acknowledge its beneficial effects by a present to himself, and a
liberal treat to the whole ward. I afterwards sent for a coach, in which
myself, my wife, and old companion, were driven to my lodgings in
Duke’s-court, Drury-lane; and, I need not add, that we spent the
remainder of the day in festivity, and heartfelt satisfaction. To account
for my absence from home, my wife had informed the landlord, that I
had met with an accident while at a friend’s house a few miles from
town, and could not be removed until I was perfectly recovered.
Notwithstanding I blessed Heaven for this fortunate escape, which I
had so little reason to expect, and thought myself supremely happy
in recovering my liberty; yet I have ever since regretted that I was not
then convicted, as there is little doubt but the capital part of the
charge would have been done away with, and I should only have
been transported for seven years, consequently, at the period of my
writing these Memoirs, I should have had only a few months to serve
before I became a free-man; whereas the sequel will shew that I was
in a short time afterwards cast for death, and now find myself in the
hopeless and deplorable situation of a prisoner for life!
CHAPTER VI.
Visit Mr. Bilger, an eminent Jeweller.—His Politeness, and the Return I made for it.
—Perfidy of a Pawnbroker.—Obliged to decamp with Precipitation.

The next adventure I shall have occasion to relate, more fully


confirms the justice of the remark, that the connexions formed by
persons during temporary confinement in a jail, commonly lead to
further acts of wickedness, and frequently entail on the parties a
more severe punishment than that which they have just escaped.
This was exactly my unhappy case, and I now come to the most fatal
era of my eventful life.
In the same ward with myself were confined two brothers, very
genteel young men, who had been recently cast for death for
privately stealing some valuable rings, &c., from the shop of a
Jeweller in Leadenhall-street. As a conformity of character, or
similarity of pursuits, is the strongest source of friendship, so these
persons and myself had become very intimately acquainted. In the
course of our frequent conversations on the subject with which we
were all three alike most conversant, the brothers informed me that
they had, like myself, made a successful tour of the jewellers’ shops
in London; and on our comparing notes as to the particular persons
we had robbed, or attempted to rob, they pointed out about half a
dozen shops, which, it appeared, I had omitted to visit, arising either
from their making no display of their goods, or from their being
situated in private streets, where I had no idea of finding any such
trades. Though at that time neither they nor myself entertained much
hope of my acquittal, it was agreed that in the event of my being so
fortunate as to recover my freedom, I should pay my respects to the
several tradesmen I had so overlooked; and I promised, in case I
was successful, to make them a pecuniary acknowledgment in return
for their information. At the moment of my joyful departure from
Newgate, they accordingly furnished me with a list of the shops in
question, and gave me full instructions and useful hints for my
guidance therein. They particularly pointed out Mr. Bilger, a
goldsmith and jeweller of the first eminence in Piccadilly. This
gentleman, they assured me, I should find, in the technical phrase, a
good flat. They advised me to bespeak a diamond ring, or similar
article, and to request a sight of some loose diamonds for the
purpose of selecting such stones as I might wish to have set,
informing me that he was generally provided with a large quantity,
which he would not fail to shew me, and that I might with ease
purloin a good number of them. A day or two after my release, I
made the prescribed experiments, and was fortunate enough to
succeed pretty well at nearly every shop, but I reserved Mr. Bilger for
my final essay, as he was the principal object of consideration, and
from whom I expected to obtain the most valuable booty. On the day
se’ennight after my trial at the Old Bailey, I prepared in due form to
pay him a visit. About five o’clock in the evening, I entered his shop,
dressed in the most elegant style, having a valuable gold watch and
appendages, a gold eye-glass, &c. I had posted my old friend and
aid-de-camp, Bromley, at the door, in order to be in readiness to act
as circumstances might require, and particularly to watch the
motions of Mr. Bilger and his assistants on my quitting the premises.
On my entrance Mrs. Bilger issued from a back-parlour behind the
shop, and politely inquiring my business, I told her I wished to see
Mr. Bilger; she immediately rang a bell, which brought down her
husband from the upper apartments. He saluted me with a low bow,
and handed me a seat. I was glad to find no other person in the
shop, Mrs. Bilger having again retired. I now assumed the air of a
Bond-street lounger, and informed Mr. Bilger that I had been
recommended by a gentleman of my acquaintance to deal with him,
having occasion for a very elegant diamond ring, and requested to
see his assortment. Mr. Bilger expressed his concern that he
happened not to have a single article of that description by him, but if
I could without inconvenience call again, he would undertake in one
hour to procure me a selection from his working-jeweller, to whom he
would immediately despatch a messenger. I affected to feel
somewhat disappointed, but looking at my watch, after a moment’s
reflection, I said, “Well, Mr. Bilger, I have an appointment at the
Canon coffee-house, which requires my attendance, and if you will
without fail have the articles ready, I may probably look in a little after
six.” This he promised faithfully to do, declaring how much he felt
obliged by my condescension; and I sauntered out of the shop, Mr.
Bilger attending me in the most obsequious manner to the outer
door. After walking a short distance, Bromley tapped me on the
shoulder, and inquired what conduct I meant next to pursue; for he
had viewed my proceedings through a glass-door in the shop, and
saw that I had not executed my grand design. I related to Bromley
the result of my conversation with Mr. Bilger, and added that I meant
to retire to the nearest public-house, where we could enjoy a pipe
and a glass of negus until the expiration of the hour to which I had
limited myself. We accordingly regaled ourselves at a very snug
house, nearly opposite Bilger’s, until about half after six, when I
again repaired to the scene of action, leaving Bromley, as at first,
posted at the door. Mr. Bilger received me with increased respect,
and producing a small card box, expressed his sorrow that his
workman had only been enabled to send three rings for my
inspection, but that if they were not to my taste he should feel
honoured and obliged in taking my directions for having one made,
and flattered himself he should execute the order to my satisfaction. I
proceeded to examine the rings he produced, one of which was
marked sixteen guineas, another nine guineas, and the third six
guineas. They were all extremely beautiful, but I affected to consider
them as too paltry, telling Mr. Bilger that I wanted one to present to a
lady, and that I wished to have a ring of greater value than the whole
three put together, as a few guineas would not be an object in the
price. Mr. Bilger’s son, who was also his partner, now joined us, and
was desired by his father to sketch a draught in pencil of some fancy
rings, agreeable to the directions I should give him. The three rings I
had viewed, were now removed to the end of the counter next the
window, and I informed the young man that I wished to have
something of a cluster, a large brilliant in the centre, surrounded with
smaller ones; but repeated my desire that no expense might be
spared to render the article strictly elegant, and worthy a lady’s
acceptance. The son having sketched a design of several rings on a
card, I examined them with attention, and appeared in doubt which
to prefer, but desired to see some loose diamonds, in order to form a
better idea of the size, &c., of each ring described in the drawing. Mr.
Bilger, however, declared he had not any by him. It is probable he
spoke truth: or he might have lost such numbers by shewing them,
as to deter him from exhibiting them in future. Without having made
up my mind on the subject, I now requested to see some of his most
fashionable broaches or shirt-pins. Mr. Bilger produced a shew-
glass, containing a great variety of articles in pearl, but he had
nothing of the kind in diamonds. I took up two or three of the
broaches and immediately sunk a very handsome one marked three
guineas, in my coat sleeve. I next purloined a beautiful clasp for a
lady’s waist, consisting of stones set in gold, which had the brilliancy
and appearance of real diamonds, but marked only four guineas. I
should probably have gone still deeper, but at this moment a lady
coming in, desired to look at some ear-rings, and the younger Mr.
Bilger immediately quitted his father to attend upon her at the other
end of the shop. It struck me that now was my time for a decisive
stroke. The card containing the diamond rings, procured from the
maker, lying very near the shew-glass I was viewing, and many small
articles irregularly placed round about them, the candles not
throwing much light upon that particular spot, and Mr. Bilger’s
attention being divided between myself and the lady, to whom he
frequently addressed himself, I suddenly took the three rings from
the card, and committed them to my sleeve to join the broach and
lady’s clasp; but had them so situated that I could in a moment have
released and replaced them on the counter, had an inquiry been
made for them. I then looked at my watch, and observing that I was
going to the theatre, told Mr. Bilger that I would not trouble him any
further, as the articles before me were too tawdry and common to
please me, but that I would put the card of draughts in my pocket-
book, and if I did not meet with a ring of the kind I wanted before
Monday or Tuesday, I would certainly call again and give him final
directions. I was then drawing on my gloves, being anxious to quit
the shop while I was well; but Mr. Bilger, who seemed delighted with
the prospect of my custom, begged so earnestly that I would allow
him to shew me his brilliant assortment of gold watches that I could
not refuse to gratify him, though I certainly incurred a great risk by
my compliance. I, therefore, answered, “Really, Mr. Bilger, I am loth
to give you that unnecessary trouble, as I have, you may perceive, a
very good watch already, in point of performance; though it cost me
a mere trifle, only twenty guineas; but it answers my purpose as well
as a more valuable one. However, as I may probably, before long,
want an elegant watch for a lady, I don’t care if I just run my eye over
them.” Mr. Bilger replied, that the greater part of his stock were fancy
watches adapted for ladies, and he defied all London united to
exhibit a finer collection. He then took from his window a shew-glass,
containing about thirty most beautiful watches, some ornamented
with pearls or diamonds, others elegantly enamelled, or chased in
the most delicate style. They were of various prices, from thirty to
one hundred guineas, and the old gentleman rubbing his hands with
an air of rapture, exclaimed, “There they are, Sir; a most fashionable
assortment of goods; allow me to recommend them; they’re all a-
going, Sir—all a-going.” I smiled inwardly at the latter part of this
speech, and thought to myself, “I wish they were going, with all my
heart, along with the diamond rings.” I answered, they were certainly
very handsome, but I would defer a minute inspection of them till my
next visit, when I should have more time to spare. These watches
were ranged in exact order, in five parallel lines, and between each
watch was placed a gold seal or other trinket appertaining to a lady’s
watch. It was no easy matter, therefore, to take away a single article
without its being instantly missed, unless the economy of the whole
had been previously deranged. I contrived, however, to displace a
few of the trinkets, on pretence of admiring them, and ventured to
secrete one very rich gold seal marked six guineas. I then declared I
could stay no longer, as I had appointed to meet a party at the
theatre; but that I would certainly call again in a few days, and lay out
some money in return for the trouble I had given. Mr. Bilger
expressed his thanks in the most respectful terms, and waited upon
me to the door, where he took leave of me with a very low congé, à
la mode de France, of which country he was a native. I now put the
best foot foremost, and having gained a remote street, turned my
head, and perceived Bromley at my heels, who seized my hand,
congratulating me on my success, and complimenting me on the
address I had shewn in this exploit; for he had witnessed all that
passed, and knew that I had succeeded in my object, by the manner
in which I quitted the shop. He informed me that Mr. Bilger, had
returned to his counter, and without attending to the arrangement of
the articles thereon, had joined his son who was still waiting upon
the lady, and that he, Bromley, had finally left them both engaged
with her.
Having thus happily achieved this adventure we returned to my
lodgings, where I displayed the booty I had made, and gratified
Bromley with a couple of guineas for his trouble, which fully satisfied
him, as I did not take him with me on terms of equal partnership. The
next morning, Saturday, on reviewing the articles, my wife was so
much pleased with one of the rings, (a beautiful ruby, surrounded
with rose-diamonds, price six guineas,) which exactly fitted her fore-
finger, that I suffered her to retain it for wearing on extraordinary
occasions; and I myself determined to keep the one marked sixteen
guineas, (which was a double rowed brilliant half hoop,) for my little
finger. As to the nine-guinea ring, (which was composed of brilliants,
having a space for hair in the centre,) I sold it immediately, together
with the gold seal, to a Jew-receiver, with whom I had frequent
dealings. The broach I also took a fancy to for my own wear, and the
gold clasp I presented to my wife. In the evening of this day I visited
my friends in Newgate, (the two brothers,) and acknowledged the
service they had rendered me by a suitable present, besides
regaling the whole ward with a treat of ale and porter.
In the interval between my discharge from confinement, and my
visit to Mr. Bilger, I one day went to the shop of a pawnbroker, in
Brydges-street, Covent-garden, for the purpose of pledging some
seals, rings, and other trinkets, which I had purloined at the several
shops to which the brothers had recommended me. I had frequently
pledged similar articles at this shop, as well as many others,
because I could get nearly fifty per cent more by that means than a
common receiver would give for the same goods, and I afterwards
sold the duplicates among my acquaintances, or to the Jews, by
which I gained a still further advance. I entered a private box, as is
usual with persons who wish to observe secrecy; and the
pawnbroker, whose name was Turner, coming himself to wait on me,
I produced my goods, demanding a certain sum upon them. Mr.

You might also like