PCI Express System Architecture - MindShare

1 Training that fi ts your needsMindShare recognizes and addresses your company s technical training issues with: Scalable cost training Customizable training options Reducing time away from work Just-in-time training Overview and advanced topic courses Training delivered effectively globally Training in a classroom, at your cubicle or home offi ce Concurrently delivered multiple-site trainingbringing lifeto knowledge. real-world tech training put into practice worldwide real-world tech training put into practice worldwide real-world tech training put into practice worldwide real-world tech training put into practice worldwideAre your company s technical training needs being addressed in the most effective manner?

2 MindShare has over 25 years experience in conducting technical training on cutting-edge technologies. We understand the challenges companies have when searching for quality, effective training which reduces the students time away from work and provides cost-effective alternatives. MindShare offers many fl exible solutions to meet those needs. Our courses are taught by highly-skilled, enthusiastic, knowledgeable and experienced instructors. We bring life to knowledge through a wide variety of learning methods and delivery PCI Express 2 Intel Core 2 Processor Architecture2 AMD Opteron Processor Architecture2 Intel 64 and IA-32 Software Architecture2 Intel PC and Chipset Architecture2 PC Virtualization2 USB Wireless USB2 Serial ATA (SATA)2 Serial Attached SCSI (SAS)2 DDR2/DDR3 DRAM Technology 2 PC BIOS Firmware 2 High-Speed Design2 Windows Internals and Drivers2 Linux and many courses can be customized to meet your group s needs.

3 Detailed course outlines can be found at technical trainingMindShare training courses expand your technical skillset*PCI Express is a registered trademark of the PCISIG*PCI Express is a registered trademark of the 4285 SLASH PINE DRIVE COLORADO SPRINGS, CO 80908 USA M O MindShareHave knowledge that you want to bring to life? MindShare will work with you to Bring Your Knowledge to Life. Engage us to transform your knowledge and design courses that can be delivered in classroom or virtual class-room settings, create online eLearning modules, or publish a book that you are proud to be the preferred training provider at an extensive list of clients that include:ADAPTEC AMD AGILENT TECHNOLOGIES APPLE BROADCOM CADENCE CRAY CISCO DELL FREESCALEGENERAL DYNAMICS HP IBM KODAK LSI LOGIC MOTOROLA MICROSOFT NASA NATIONAL SEMICONDUCTORNETAPP NOKIA NVIDIA PLX TECHNOLOGY QLOGIC SIEMENS SUN MICROSYSTEMS SYNOPSYS TI UNISYSC lassroom TrainingInvite MindShare to train you in-house, or sign-up to attend one of our many public classes held throughout the year and around the world.

4 No more boring classes, the MindShare Experience issure to keep you Classroom TrainingThe majority of our courses live over the web in an inter-active environment with WebEx and a phone bridge. We deliver training cost-effectively across multiple sites and time zones. Imagine being trained in your cubicle or home offi ce and avoiding the hassle of travel. Contact us to attend one of our public virtual Module TrainingMindShare is also an eLearning company. Our growing list of interactive eLearning modules include: Intro to Virtualization Technology Intro to IO Virtualization Intro to PCI Express Updates PCI Express USB AMD Opteron Processor Architecture Virtualization Technology.

5 And moreMindShare PressPurchase our books and eBooks or publish your own content through us. MindShare has authored over 25 books and the listis growing. Let us help make your book project a successful Learning OptionsMindShare ClassroomMindShare Virtual ClassroomMindShare eLearningMindShare PressIn-House TrainingPublic TrainingVirtual In-House TrainingVirtual Public TrainingIntro eLearning ModulesComprehensive eLearning ModulesBookseBooksPCI Express SystemArchitectureMINDSHARE, BudrukDon AndersonTom ShanleyTechnical Edit by Joe WinklesADDISON-WESLEY DEVELOPER S PRESS Boston San Francisco New York TorontoMontreal London Munich Paris Madrid Sydney Cape Town Tokyo Singapore Mexico CityMany of the designations used by manufacturers and sellers to distinguish their prod-ucts are claimed as trademarks.

6 Where those designators appear in this book, and Add-ison-Wesley was aware of the trademark claim, the designations have been printed in initial capital letters or all capital authors and publishers have taken care in preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connec-tion with or arising out of the use of the information or programs contained of Congress Cataloging-in-Publication DataISBN: 0-321-15630-7 Copyright 2003 by MindShare , rights reserved. No part of this publication may be reproduced, stored in a retrieval System , or transmitted, in any form or by any means, electronic, mechanical, photocopy-ing, recording, or otherwise, without the prior written permission of the publisher.

7 Printed in the United States of America. Published simultaneously in Editor: Project Manager: Cover Design: Set in 10 point Palatino by MindShare , 2 3 4 5 6 7 8 9-MA-999897 9th Printing, April, 2008 Addison-Wesley books available for bulk purchases by corporations, institutions, and other organizations. For more information please contact the Corporate, Government, and Special Sales Department at (800) A-W Developer s Press on the World-Wide Web at: This BookThe MindShare Architecture Series .. 1 Cautionary Note .. 2 Intended Audience .. 2 Prerequisite Knowledge .. 3 Topics and Organization .. 3 Documentation Conventions .. 4 PCI Express .. 4 Hexadecimal Notation .. 4 Binary Notation .. 4 Decimal Notation.

8 4 Bits Versus Bytes Notation .. 5 Bit Fields .. 5 Active Signal 5 Visit Our Web Site .. 5We Want Your One: The Big PictureChapter 1: Architectural PerspectiveIntroduction To PCI Express ..9 The Role of the Original PCI 10 Don t Throw Away What is Good! Keep It .. 10 Make Improvements for the Future .. 10 Looking into the Future .. 11 Predecessor Buses Compared .. 11 Author s 12 Bus Performances and Number of Slots Compared .. 12 PCI Express Aggregate Throughput .. 13 Performance Per Pin Compared .. 14 I/O Bus Architecture Perspective .. 1633 MHz PCI Bus Based System .. 16 Electrical Load Limit of a 33 MHz PCI 17 PCI Transaction Model - Programmed IO .. 19 PCI Transaction Model - Peer-to-Peer.

9 22 PCI Bus Arbitration .. 22 PCI Delayed Transaction Protocol .. 23 PCI Retry Protocol: .. 23 PCI Disconnect Protocol: .. 24 PCI Interrupt 25 ContentsviiiPCI Error Handling .. 26 PCI Address Space Map .. 27 PCI Configuration Cycle Generation .. 29 PCI Function Configuration Register Space .. 30 PCI Programming Model .. 31 Limitations of a 33 MHz PCI System .. 31 Latest Generation of Intel PCI Chipsets .. 3266 MHz PCI Bus Based System .. 33 Limitations of 66 MHz PCI bus .. 34 Limitations of PCI 3466 MHz and 133 MHz PCI-X Bus Based 35 PCI-X 36 PCI-X Requester/Completer Split Transaction Model .. 37 DDR and QDR PCI-X Bus Based Platforms .. 39 The PCI Express Way .. 41 The Link - A Point-to-Point Interconnect.

10 41 Differential Signaling .. 41 Switches Used to Interconnect Multiple Devices .. 42 Packet Based Protocol .. 42 Bandwidth and Clocking .. 43 Address Space .. 43 PCI Express Transactions .. 43 PCI Express Transaction 43 Error Handling and Robustness of Data Transfer .. 44 Quality of Service (QoS), Traffic Classes (TCs) and Virtual Channels (VCs) .. 44 Flow Control .. 45 MSI Style Interrupt Handling Similar to PCI-X .. 45 Power 45 Hot Plug Support .. 46 PCI Compatible Software 46 Mechanical Form Factors .. 47 PCI-like Peripheral Card and Connector .. 47 Mini PCI Express Form 47 Mechanical Form Factors Pending 47 NEWCARD Form Factor .. 47 Server IO Module (SIOM) Form 47 PCI Express Topology .. 48 Enumerating the 50 PCI Express System Block Diagram.