6
\$\begingroup\$

I am not being able to find a clear description of what configuration means in PCI and PCIe. I have found something called as configuration space, but without knowing what configuration means, it is not possible to really understand what configuration space is.

So what does configuration and a configuration space in PCI and PCIe mean? And how is this different from "Enumeration"?

\$\endgroup\$
10
\$\begingroup\$

Each PCI device (when I write PCI, I refer to PCI 3.0, as opposed to PCIe) has two "ranges" - configuration range (CFG) and "memory mapped input-output" range (MMIO). I won't deep dive into the concepts of address spaces and MMIO because it will make the answer too long and complicated. Google them if they are not familiar to you. In short: CFG range is a standard set of registers used to configure the PCI device; MMIO range is a customary set of registers. In other words: CFG ranges are the same across all PCI devices (there might be slight differences, but the majority of registers are standard); MMIO ranges are device specific (NOTE: while the terms "range" and "space" are not synonyms, there is a consensus to call an MMIO range of the device MMIO space. I'll use them interchangeably)

Now, the size of CFG space is standard - there is an upper bound on the number of registers CFG space can contain and it is the same for each PCI device. Usually, the actual number of registers in CFG space is much smaller than the maximal. The size of MMIO space, on the other hand, is not constant. Why? Well, different devices need different number of registers for communication.

Now think about it for a moment: if the size of MMIO space is not constant, then we need to provide the information about this size of a particular device to the computer in some way, right? One option would be to manually define these parameters for each device. It is the way the early computers worked: you really had to configure each device you plug into a computer by hand. Today we are lazy and want the "plug-and-play" functionality - the computer must obtain this info by itself the moment a new device is added.

In order to allow for "plug-and-play" in PCI devices, the concept of MMIO Base Access Registers (MMIO BARs) was introduced. These registers reside in CFG space of each device (I think that there up to five BARs per CFG space are allowed). The flow is as follows:

  1. a computer knows to search for these registers during a startup
  2. a computer reads the BARs in order to understand what sizes of MMIO ranges does this device require
  3. a computer allocates the device's MMIO spaces, which become standard MMIO ranges in the global MMIO space
  4. a computer writes back to MMIO BARs the addresses assigned for each device's MMIO range in the global MMIO space.

The above 4 stages are known as "enumeration" of the device - i think that it is usually the BIOS who performs devices' enumeration during the startup.

Except for BARs, CFG space of a device contain many more registers. All other writes to CFG space, which is not part of "enumeration" flow, are called "configuration" of the device. This includes runtime configurations such as: interrupt selection, MSI vectors and addresses, device's power states and many more.

In summary: "enumeration" is the flow executed at startup which allocates MMIO ranges to all the devices. "configuration" is all other writes to CFG space of the device (in general, "enumeration" is included in "configuration").

NOTE: this description is simplified. There are more aspects both to "enumeration" and to "configuration".

Offtopic:

It seems that you are new to PCIe and want to get a fast introduction. While your desire is totally understandable (it will take you a way more time to understand PCIe if you don't ask questions), I believe that nothing can replace the original spec. The problem is that PCIe spec is written in the manner which assumes that you're familiar with PCI (at least it seemed that way to me) - you need to read it first. So, start by googling PCI 3.0 specification and PCIe 2.1 specification. These documents are frustratingly long, but they'll become your bible if you're really going to work with PCIe devices.

\$\endgroup\$
  • \$\begingroup\$ The first paragraph belongs in a comment on the question. \$\endgroup\$ – Mels Jul 25 '13 at 12:14
  • \$\begingroup\$ Dear Vasiliy, I have the PCIe 3.0 specs with me but they did not seem to describe what configuration itself means. They just went into it as "... these are the configuration registers" "... this is the configuration space". I was like, ok, but what is configuration. I could not find answer to this question anywhere. I also have 2 books PCI demystified and PCI system architecture by mindshare. If I do post any more questions, it will be just 1 more. But first I will try to find the answer myself. I only asked question if things were not clear in the documents. Thank you very much for your time. \$\endgroup\$ – quantum231 Jul 25 '13 at 12:19
  • \$\begingroup\$ All I need is direction, I would not expect anyone to pour a whole white paper in response to my question. After all everyone is quite busy. Thank you. \$\endgroup\$ – quantum231 Jul 25 '13 at 12:20
  • 2
    \$\begingroup\$ @quantum231, no offense man! I didn't mean to say that your question is unnecessary or bad. If I did think this way - no way I would spend my time on it. All I wanted to say is that you must read the specs. If you already do - way to go! I myself spent a lot of time reading them, and I know perfectly well that a bit of explanations could speed up the process dramatically. \$\endgroup\$ – Vasiliy Jul 25 '13 at 12:23
  • \$\begingroup\$ thank you so much, from this day onwards you are my sensei. \$\endgroup\$ – quantum231 Jul 26 '13 at 8:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.