US20080256455A1 - Method for Defining the Physical Configuration of a Communication System - Google Patents
Method for Defining the Physical Configuration of a Communication System Download PDFInfo
- Publication number
- US20080256455A1 US20080256455A1 US12/103,683 US10368308A US2008256455A1 US 20080256455 A1 US20080256455 A1 US 20080256455A1 US 10368308 A US10368308 A US 10368308A US 2008256455 A1 US2008256455 A1 US 2008256455A1
- Authority
- US
- United States
- Prior art keywords
- elements
- sub
- macros
- tables
- subsystem
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000004891 communication Methods 0.000 title description 6
- 230000004044 response Effects 0.000 claims abstract description 33
- 230000006399 behavior Effects 0.000 claims abstract description 22
- 239000004744 fabric Substances 0.000 claims description 55
- 230000015654 memory Effects 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims 4
- 230000002629 repopulating effect Effects 0.000 claims 2
- 230000035876 healing Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 4
- 230000001419 dependent effect Effects 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- MXRPNYMMDLFYDL-YFKPBYRVSA-N AMCC Chemical compound CNC(=O)SC[C@@H](C(O)=O)NC(C)=O MXRPNYMMDLFYDL-YFKPBYRVSA-N 0.000 description 1
- 241001522296 Erithacus rubecula Species 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000012913 prioritisation Methods 0.000 description 1
- 229940036310 program Drugs 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/25—Routing or path finding in a switch fabric
- H04L49/252—Store and forward routing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/20—Support for services
- H04L49/205—Quality of Service based
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/30—Peripheral units, e.g. input or output ports
- H04L49/3018—Input queuing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/30—Peripheral units, e.g. input or output ports
- H04L49/3027—Output queuing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/50—Overload detection or protection within a single switching element
- H04L49/501—Overload detection
- H04L49/503—Policing
Definitions
- This invention generally relates to software programming and, more particularly, to a method for automating generating code that defines and controls a system of network-connected hardware elements.
- SCSA Simucular Computing System Architecture
- FIG. 10 is a schematic block diagram of a general switch fabric system (prior art). Traffic enters the system on the ingress side (the left side of the figure). Traffic exits the system on the egress side (the right side of the figure).
- the port card ingress and egress structures are sometimes subdivided into channels and subchannels.
- the packet headers specify a required destination port card, channel, and subchannel. The system must synchronously route each ingress packet to the correct egress destination.
- Packets are converted into frames by ingress traffic managers (iTMs).
- a frame is a logical unit of data, which is often a small piece of a much larger data set such as a file or image.
- the iTMs feed the ingress side of the fabric.
- the switch fabric might convert the frame format to a “native” format, and then on egress, convert the data back into the TM frame format before sending the data to the egress traffic managers (eTMs). If the frames are fixed size (for example: 53 bytes, 64 bytes, or 80 bytes), the frames are often called cells.
- a switch fabric can be protocol specific or protocol agnostic.
- An example of a protocol specific switch fabric would be a system designed and optimized specifically for asynchronous transfer mode (ATM) traffic.
- Another example would be a switch that handles only TCP/IP traffic.
- ATM synchronous transfer mode
- the obvious disadvantage of a switch fabric hardwired to handle a specific protocol is lack of flexibility. Service providers want to sell services to a variety of customers in various industries. Protocols vary from industry to industry.
- IPv4 the machine language of Internet routers
- IPv6 The next generation Internet protocol is “IPv6.” It provides solutions to these limitations.
- a protocol agnostic switch fabric works equally well with all protocol types, however, the traffic manager must be responsible for recognizing specific protocol types.
- the disadvantage of a protocol agnostic switch fabric is that it may be more complicated, and perhaps slower than a switch fabric dedicated to a particular protocol.
- the simplest way for a traffic manager to transmit a packet into a switch fabric is to transmit the packet serially along one line.
- Striping is a way of achieving higher bandwidth by transmitting a single packet across multiple ingress/egress lines.
- a TM can transmit a packet into a switch fabric eight times as fast if the packet is sliced into eight pieces (stripes) by the TM, and conveyed into the fabric along 8 parallel lines simultaneously.
- the fabric captures the packet in memory, routes it to the required egress destination, and slices the packet into 8 parallel lines before transmitting the packet to the egress TM.
- ATM packets are single-cell packets, with a fixed cell size of 53 bytes, 48 bytes of which is the information payload.
- the ATM specification evolved in the 1980s and early 1990s. It was then believed that variable length (multi-cell) packets would be too difficult to implement at rates needed for wire-speed traffic.
- the single-cell solution was a compromise that would work for voice data, video data, multimedia data, email data, file data, etc. With a fixed frame size, switch designs are simplified and ultimately faster.
- the ingress port card For large frames or packets it is much more efficient to establish a path from an ingress port card to the required egress destination, and then leave this path undisturbed until the packet is completed. With single cell packets, the ingress port card must bid for, accept grants, and then schedule each cell of a multi-cell packet.
- Frame Relay switch fabrics There are also Frame Relay switch fabrics.
- Frame Relay is a single-cell protocol, albeit with frame size ranging from 6 to 4096 bytes. Such switch fabrics have been deployed and passing revenue traffic since the early 1990s. These switch fabrics have generally not been used for voice data because of the large latency. Only highly compressed voice traffic works well over frame relay. Voice-over-frame relay was added as an afterthought by network engineers. Frame relay excels at data communications such as local area network internetworking (LAN-to-LAN). Such communications are very high speed and bursty, with non-critical latency constraints.
- LAN-to-LAN local area network internetworking
- the conventional method of switch fabric packet routing is called Store-and-Forward.
- the switch fabric accepts an input packet and buffers the packet on the ingress side of the fabric, making sure the packet was received intact, knowing the exact number of cells in the packet.
- the problem with the store-and-forward method is the added latency of buffering the packet.
- CPR Cut-through Packet Routing
- a switch fabric can use memory-based crossbars or arbitrated crossbars.
- a memory-based crossbar is sometimes called a “shared memory switch.” Ingress packets flow from the port cards into a huge memory bank, which serve as the switch. From the memory bank, the destination address is determined from egress port destination information in the cell headers.
- the problem with these switch fabrics is that they become prohibitively expensive and large from all the required high-speed memory. Such fabrics cannot be used to reach terabit total switching speeds with technology available today.
- firmware executable code could be easily created for new customers by field application engineers (FAEs).
- FEEs field application engineers
- code generation could occur without the need for delving into the finer details of the firmware, knowing the chipset register definitions, or modifying the source code. If the firmware generation process could be highly automated, customers could even learn how to deploy a wide variety of system configurations themselves, with little FAE support, after receiving training for the chipset and its firmware environment.
- GUI graphical user interface
- Cyclone Switch Fabric A good example of a candidate chipset for employing the method described above is the Cyclone Switch Fabric. This set of four chips has thousands of registers and 100's of millions of logic gates. A huge and steep learning curve must be overcome for even the most seasoned firmware engineer to master the multiplicity of register settings, system configuration options, and complex algorithms used in the firmware. It would be advantageous of the Cyclone chipset firmware can developed for new systems with the help of automated tools.
- chipsets might include framers, media access controllers (MACs), PHY devices (used in the OSI Physical layer), Physical Medium Dependent (PMD) devices, framers, network processors, and traffic managers. All such devices have registers, which must be loaded to configure the devices and registers, which must be read to monitor the health and status of the devices. All such devices also must be connected together in a specific manner in a newly proposed system (the form of the system). And all such devices have a multiplicity of parameter selections (the function of the system). The system engineer, solutions architect, or FAE could use the automated firmware tools on customer visits to propose new solutions to customer needs.
- MACs media access controllers
- PMD Physical Medium Dependent
- a method for automatically generating code to define and control a system of connected hardware elements comprises: accepting a system configuration macro with sub-macros for system elements, subsystem elements, and connections there between; accepting a plurality of tables with a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options; defining the system of connected elements in response to selecting sub-macros; defining the physical links between the system elements and the behavior of the system and subsystem elements in response to populating the selected sub-macro parameters; expanding the selected sub-macros; generating executable code; and, accessing the tables in response to parameters in the executable code.
- the expansion of the sub-macros defines the form and the function of the network hardware, with programming.
- FIG. 1 a is a flowchart illustrating the present invention method for automatically generating code to define and control a system of connected hardware elements.
- FIG. 1 b illustrates specifics relating to Steps 102 and 104 of FIG. 1 a.
- FIG. 2 is a flowchart illustrating the present invention method for automatically generating code to define and control a switch fabric of connected cards.
- FIG. 3 is a flowchart illustrating another aspect of the present invention method for automatically generating code to define and control a system of connected hardware elements.
- FIG. 4 is a diagram illustrating the hierarchy of the system configuration file.
- FIG. 5 is an illustration of code that is generated for each macro in the Systemconfiguration.cfg file.
- FIG. 6 illustrates the relationship between configuration files and configuration tables.
- FIG. 7 depicts an excerpt of a PQ chip configuration file.
- FIG. 8 illustrates how the configuration file is indexed, to locate the tables that contain the values to program into the chip registers for a given chip configuration mode.
- FIG. 9 is a flowchart illustrating the present invention method for autonomously discovering the configuration of system-connected elements.
- FIG. 10 is a schematic block diagram of a general switch fabric system (prior art).
- FIG. 1 a is a flowchart illustrating the present invention method for automatically generating code to define and control a system of connected hardware elements.
- the method (and methods associated with FIGS. 2 and 3 below) is depicted as a sequence of numbered steps for clarity, no order should be inferred from the numbering unless explicitly stated. It should be understood that some of these steps may be skipped, performed in parallel, or performed without the requirement of maintaining a strict order of sequence.
- the method starts at Step 100 .
- Step 102 generates a system configuration macro.
- Step 104 generates tables defining a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options.
- FIG. 1 b illustrates specifics relating to Steps 102 and 104 of FIG. 1 a .
- Steps 102 and 104 are accomplished using a graphical user interface (GUI).
- GUI graphical user interface
- the steps are enabled by the manual entry of parameters.
- Step 106 accepts the system configuration macro with sub-macros for defining system elements, subsystem elements, and connections there between.
- Step 108 selects sub-macros.
- Step 110 populates parameters in the selected sub-macros.
- Step 112 accepts the plurality of tables defining a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options.
- Step 114 expands a plurality of sub-macros with populated parameters. In some aspects, Step 114 expands the parameters of the selected sub-macros.
- Step 116 generates executable table indexing code. For example, the code can be generated by means of a complier specific to the target processor.
- Step 118 elaborates the executable code.
- Step 120 accesses the tables in response to parameters in the executable code. The above-mentioned steps describe the steps that a user would perform to define, compile, and run the code.
- elaborating the executable code in Step 118 includes differentiating the executable code into code sections corresponding to system and subsystem elements. Then, accessing the tables in response to the parameters in the executable code in Step 120 includes loading accessed tables into corresponding subsystem element memories.
- accepting the system configuration macro with sub-macros for defining system elements, subsystem elements, and the connections there between, in Step 106 includes accepting a hierarchical set of fields, with subsystem elements being indentured to system elements.
- accessing the tables in response to the parameters in the executable code in Step 120 includes substeps.
- Step 120 a accesses a sub-table in response to indexing a table.
- Step 120 b loads values from the sub-table in chip registers.
- expanding the plurality of sub-macros with populated parameters in Step 114 includes generating C++ language code.
- generating executable code in Step 116 includes generating machine code.
- Step 106 includes accepting a switch fabric configuration macro for defining switch fabric cards, firmware processing integrated circuits (chips) on the cards, and the connections between the cards. Further, Step 106 may include accepting sub-macros to hierarchically define the system level (slot number), the slot level (card type), card level (chip type), and chip level (link types and endpoint).
- accepting sub-macros to hierarchically define the system level, the slot level, card level, and chip level includes differentiating at the slot level between port cards to manage traffic flow in and out of the switch fabric, and switch cards to manage backplane traffic flow between the port cards.
- Step 106 includes differentiating at the port card level between memory subsystems (MSs) and queuing/scheduling (QS) devices.
- Step 106 includes differentiating at the switch card level between arbiter and crossbars. Further, Step 106 may include defining MS chip level data link connections.
- Defining MS chip level data link connections may further include defining input port card ingress data links, backplane data links, and output port card egress data links.
- accepting sub-macros to hierarchically define the system level, the slot level, card level, and chip level, in Step 106 includes defining PQ chip level control link connections. That is, defining grant/bid control links between input port card ingress QS devices and switch card arbiters and defining grant/bid control links between output port card ingress QS devices and switch card arbiters.
- accepting sub-macros in Step 106 includes defining the chip level. Then, accessing the tables in response to parameters in the executable code in Step 120 includes accessing tables to define chip default register settings and chip modes.
- Step 122 following the elaboration of the executable code, monitors system performance.
- Step 124 compares the system performance to a standard.
- the standard may be that the data and/or control links merely interface. Alternately, the standard may be a bit error rate, for example, or an information bandwidth.
- Step 126 in response to sub-standard system performance: automatically repopulates selected parameters in the selected sub-macros; accesses tables in response to the repopulated parameters; and, instantiates new executable code.
- Step 122 through 126 may be preformed iteratively until a minimum level (the standard) of system performance is obtained. In other aspects, the method may shut to system down if a minimum level of performance is not (eventually) achieved.
- FIG. 2 is a flowchart illustrating the present invention method for automatically generating code to define and control a switch fabric of connected cards.
- the method starts at Step 200 .
- Step 202 accepts a system configuration macro with sub-macros for defining switch cards, port cards, integrated circuits (chips) on the cards, and the connections there between.
- Step 204 accepts a plurality of tables defining a plurality of card behaviors, a plurality of chip behaviors, and a plurality of connection options.
- Step 206 selects sub-macros.
- Step 208 populates parameters in the selected sub-macros.
- Step 210 expands the selected sub-macros.
- Step 212 generates executable code.
- Step 214 elaborates the executable code.
- Step 216 following Step 214 , indexes the tables in response to the populated parameters.
- elaborating the executable code in Step 214 includes differentiating the executable code into code sections corresponding to cards and chips. Then, indexing the tables in response to calling the parameters (Step 216 ) includes loading accessed tables into corresponding card chip memories.
- Step 218 following the elaboration of the switch fabric with the executable code, monitors switch fabric performance.
- Step 220 compares the switch fabric performance to a standard.
- Step 222 in response to sub-standard switch fabric performance: automatically repopulates selected parameters in the selected sub-macros; indexes tables in response to the repopulated parameters; and, instantiates new executable code.
- FIG. 3 is a flowchart illustrating another aspect of the present invention method for automatically generating code to define and control a system of connected hardware elements.
- the method starts at Step 300 .
- Step 302 accepts a system configuration macro with sub-macros for system elements, subsystem elements, and connections there between.
- Step 304 accepts a plurality of tables with a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options.
- Step 306 defines the system of connected elements in response to selecting sub-macros.
- Step 308 defines the physical links between the system elements and the behavior of the system and subsystem elements in response to populating the selected sub-macro parameters.
- Step 310 expands the selected sub-macros.
- Step 312 generates executable code.
- Step 314 accesses the tables in response to parameters in the executable code.
- FIG. 9 is a flowchart illustrating the present invention method for autonomously discovering the configuration of system-connected elements.
- the method starts at Step 400 .
- Step 402 initially populates parameters in a macro.
- the macro is populated with default parameters.
- Step 404 elaborates table indexing executable code.
- Step 406 compares the system performance to a standard.
- Step 408 in response to sub-standard system performance: automatically repopulates parameters in the macro; indexes tables in response to the repopulated parameters; and, instantiates new table indexing executable code.
- the present invention methods use C++ macros to define the physical configuration of a multi processing packet switch fabric system in a hierarchical manner that includes automatic code generation and chip register programming.
- the System Configuration File is a human-readable configuration file and a C++ source file containing C++ macros combine to expand into executable code that forms the run-time implementation of the a packet switch fabric system, for example.
- the system configuration file is a human-readable text file that defines the hardware layout in its entirety, and performs initial programming of the chips for a discovered hardware configuration.
- FIG. 4 is a diagram illustrating the hierarchy of the system configuration file.
- the format of the configuration file is itself hierarchical, indentured to reflect higher and higher specificity of the system.
- the firmware actively monitors the health of control and data links between switch chips and adjusts data and control paths dynamically to maintain optimum performance levels. This includes automatic re-assignment of control links and addition or removal of data links. Multiple levels of control performance is supported if the number of control links limits credit bandwidth, automatically switching to dual-credit mode to preserve credit bandwidth.
- the present invention method is different from conventional system configuration macros in that the form and function of an entire physical subsystem is described and defined in a text file consisting of C++ language macros and hierarchical data tables.
- EMS Element Management System
- EMS Element Management System
- provisioning database that describes cross-connect configurations, equipment and facility states.
- Various layers of system code use this database to program the hardware.
- the physical configuration of the system is opaque to this software.
- the physical layout, connectivity is manifest only when viewed by an operator through the use of a graphical user interface (GUI) that creates a diagram, or as a result of a report output.
- GUI graphical user interface
- the present invention system configuration file and tables makes the firmware agnostic of the complete subsystem, enabling it to autonomously reconfigure itself based on its own discovery.
- a complex system is modeled as a hierarchy of autonomous subsystems managed by a high-level communication protocol.
- the approach is also flexible; practically every physical parameter of the system is captured in the configuration tables.
- human-readable macro text is pre-processed, not interpreted. Therefore, any ANSII C++ preprocessor can process it.
- a special program is not required for interpretation, as an interpreter need not be created to process the file.
- the invention is useful in that the tables that drive the configuration file can be used as input to a GUI that can graphically diagram how the system is configured both physically and functionally. That is, the combination of system configuration file and the tables completely describe both the physical and functional aspects of the switch subsystem.
- the present invention method is enabled, in one specific embodiment, as the Cyclone Firmware Subsystem (CFS) System Configuration mechanism, that encapsulates the form and function of an entire physical Cyclone Switch Subsystem (CSS) in a text file consisting of C++ language macros and hierarchical data tables.
- CFS Cyclone Firmware Subsystem
- the configuration system is key to ease of use and flexibility, capturing every physical parameter of the CSS in human-readable tables and macros that can be processed by any ANSII C++ preprocessor to generate the code required to run on any variant of a Cyclone switch system. No special interpreters or proprietary pre-processors are required.
- the CFS configuration mechanism is not hardware independent, but configuration independent, meaning the CFS can re-program the Cyclone chips to accommodate all possible system configurations.
- GUI Graphical User Interface
- the Configuration Table Module consists of the system configuration files and associated methods. This architectural feature of the CFS abstracts the entire Cyclone switch fabric into one central configuration file.
- the configuration table allows a complete Cyclone fabric subsystem to be defined and modified without the need to re-program, greatly simplifying the system management overhead required to provision, monitor and upgrade the packet fabric subsystem.
- the SystemConfiguration.cfg file contains macros that describe the hardware configuration to the Cyclone firmware.
- the macros expand into object code that executes on the switch card CPU.
- the SWITCH_CARD macro will be replaced by code that, upon execution (elaboration), will instantiate a switch_Card object.
- the System Configuration File is a human-readable configuration file and a C++ source file containing C++ macros combine to expand into executable code that forms the run-time implementation of the Cyclone packet switch fabric system. It defines the hardware layout in its entirety, and performs initial programming of the cyclone chips for a discovered hardware configuration.
- the format of the configuration file is itself hierarchical, indentured to reflect higher and higher specificity of the system.
- FIG. 5 is an illustration of code that is generated for each macro in the Systemconfiguration.cfg file.
- the left side of the page shows the macro lines in the SystemConfiguration.cfg file, and the right side shows the code that gets generated in SystemConfiguration.cpp (actually, SystemConfiguration.cfg is included at the SystemConfiguration.cpp source file, but broken out as a separate file for clarity).
- SystemConfiguration.cfg provides the initial overall slot layout that defines which card type occupies what slot and what chips are configured on each card.
- the macros in this file are expanded into code by the compiler to make up methods in the ConfigTable object. At startup, these methods verify the hardware configuration, and read values from the tables described below, to program the Cyclone chips on the cards that are found.
- the System Configuration file “SystemConfiguration.cfg” is modified by the system designer at build time to reflect the hardware layout of the Cyclone fabric.
- the contents are used at compile time to generate methods that make up the Configuration Table object, which is instantiated at run time to verify the hardware configuration and to pro-gram default values into the chips.
- the configuration information and the class methods that operate upon this information are included in the boot image that is present in the persistent store of the primary switch card (either hard disk, or some type of EPROM).
- a configuration table can also be downloaded to the primary card from the host during startup.
- the firmware starts with a copy of the base tables and successively merges in the appropriate entries from the other tables.
- the final result is programmed in the chips.
- the following header files contain tables that are hierarchical, with the first configuration file having the broadest scope for a particular chip type, and successive files having more resolution into the settings of individual chips.
- FIG. 6 illustrates the relationship between configuration files and configuration tables.
- Self healing is a process by which the firmware dynamically changes system configurations to overcome system failures. Once corrected, the system brings itself back to a new “standard” of performance.
- the firmware monitors the health of control and data links between switch chips and dynamically re-routes data and control information when links fail, in order to maintain optimum performance levels. Data and control traffic loading is also re-balanced when cards are inserted or removed from the system. Multiple levels of control performance is supported if the number of control links limits credit bandwidth, automatically switching to dual-credit mode to preserve credit bandwidth.
- the mode changes are the result of selecting different mode tables and re-programming the chip registers with values from those tables.
- Load Balancing would equally balance the “load” of port cards being configured and monitored by a processor on a switch card.
- Each such processor through its dedicated Arbiter, can supervise up to 32 port cards. But if there are four working switch cards in the system, each processor would supervise 8 port cards in a load-balanced system. If one switch card were then to fail, the self healing firmware would detect this failure, and a load balancing routine might reallocate ports to switch cards such that 11 port cards are each supervised by switch cards 1 and 2 , and the remaining 10 port cards are supervised by switch card 3 .
- the Cyclone firmware is a collection of task objects that execute on the switch card CPUs. Communicating through a TCP/IP connection, the Cyclone firmware can be controlled by any host processor through a supplied Application Programming Interface (API). Configurable entirely through the use of configuration files, the Cyclone firmware is a distributed system providing fault-tolerant control of up to 16 switch cards and 32 port cards to program, monitor and control the Cyclone chips in a Cyclone switch fabric system. Typically, a switching subsystem contains multiple, intelligent switch cards that are connected through an internal network in a loosely coupled fashion.
- API Application Programming Interface
- a Cyclone Switch Subsystem is generally distributed among the port cards and the switch cards.
- the port cards contain input and output queue chips (8505 iPQ and oPQ, 8805 EDFQ) and memory subsystem chips (8905 iMS and eMS).
- the switch cards contain an Arbiter (8605) and up to five Crossbar chips (Arbiters and Crossbars are both 8605 parts but are configured by a jumper to operate in either Arbiter or Crossbar mode). Included in the CSS is a controlling CPU that is resident on every switch card.
- the firmware provides the capability to resynchronize individual credit counters in the PQ chips on a periodic basis, or on-demand in case errors are detected by the firmware.
- the firmware will re-synchronize the appropriate flow control counters of those particular ports for which an error was detected.
- credit resync is the result of detecting a status flag set by the S8605 Arbiter chip, indicating either a soft or permanent link error, or by the system detecting that a switch card has failed. If a credit-carrying control link goes down, the link will be re-assigned and the credit counters resynchronized.
- the failure of a control link between an Arbiter and PQ indicates to the firmware that backplane tokens cannot be reliably communicated over the failed link.
- the port card may need to be managed by a different switch card in order to re-establish connectivity to the chips on the port card.
- the BP_CBFC configuration of the switch may need to be updated.
- the register settings of the appropriate Arbiter chips must be updated, followed by those on the MS chips, and ultimately those on the PQ chips.
- Reconfiguration of the control links is performed by selecting an appropriate map from the PQ chip configuration file.
- FIG. 7 depicts an excerpt of a PQ chip configuration file.
- the firmware will scan its configuration tables in the file ScChipConfigRegs_PQ_I.h to determine the next best-fit credit resync configuration.
- the configuration file contains register settings for the different Cyclone configurations.
- the “mode” field is used to index into the configuration file to select register maps for a given mode.
- the mode field is made up of subfields that include credit mode and credit mask settings.
- Chip Configuration Mode is used as an index into the configuration tables to select the appropriate tables containing the chip register values for a given Chip Configuration Mode.
- the “Family Mask” defines alternate configurations to support load balancing and self healing. Family Mask is combined with Chip Configuration Mode to find compatible modes for alternate credit transmission/reception. The search is done in the order that the various configurations occur in the configuration file, with the most optimal configurations occurring first, followed by less optimal configurations. At some point the number of links becomes small enough to change the credit mode to “dual” mode, so that each credit returned to an iPQ is counted as two credits, to halve the number of credits that are needed to keep the switch running.
- FIG. 8 illustrates how the configuration file is indexed, to locate the tables that contain the values to program into the chip registers for a given chip configuration mode.
- the firmware When the firmware detects a control or data link error during polling, it sends an internal system error message to the system error handler on the primary switch card. At the same time, an error message is sent to the user.
- the system error handler reconfigures the switch when it receives a control link failure error and, synchronizes the credit counters of all PQ's when it receives a data link failure error.
- the failure of a control link between an Arbiter and PQ indicates to the firmware that tokens cannot be reliably communicated over the failed link.
- the port card may need to be managed by a different switch card in order to re-establish connectivity to the chips on the port card (this is referred to as self healing from the Firmware perspective, as opposed to load balancing from the switch's perspective, which balances cell traffic load among the available links).
- the Credit Based Flow Control (CBFC) configuration of the switch may need to be updated.
- CBFC Credit Based Flow Control
- the self healing Process does the following:
- Data link failures are detected on the receive side of the ingress MS during register polling. The Host is notified of these failures.
- a data link failure detected on the receive side of the ingress MS indicates that there's an error on the data link between the traffic manager and the iMS.
- the firmware has a map of how the TM links map between the ingress MS and egress MS chips. Using this map, the system error handler will disable the data link in the eMS “Output Link Enable” bit mask that corresponds to the failed data link detected by the ingress MS.
- Each link is monitored for 8B/10B violations, frame misalignment, byte misalignment, loss of CDR lock, and FIFO overflow/underflow.
- link error threshold exceeded for a link
- the Crossbar will initiate a report to the Arbiter over the token bus. The result is that the Arbiter will no longer grant transmissions over that link.
- An idle cell is automatically generated by the Crossbar for those outputs that have no corresponding valid input.
- the errored link is detected during register polling and the Host is notified. Disabling a link reduces switch performance and should be cause for removal of the offending card(s).
- Data Link Failure from Crossbar to Egress MS Data link failures are detected on the receive side of the egress MS (from backplane or another MS) during register polling. The Host is notified of these failures. Failed backplane links between the Crossbar and receiving eMS are communicated to the iPQ on the same port card by the MS2PQ_LINK_FC signal, which communicates all receive link status in round robin order. Once the iPQ gets a failed link notification, it passes the information to the Arbiter during bids (byte-7, bit- 1 ) so that the Arbiter will stop using that link to grant connections to the respective egress port and channel (and subchannel).
- the iPQ indicates a credit counter timeout “error” in bit 2 of its High Priority Message register (register 254 ).
- the error is detected by a polling task, which reports it to its local XbarCard task. This task does not report the error to the user nor to the system error handler task. Instead, the XBarCard task intercepts the error and sends the NOT_SYNCH_TIMED_OUT_COUNTERS message to the local CreditResync task.
- the local CreditResync task detects which specific counter or counters have timed out by reading the timed out counters bit mask from the iPQ.
- the CreditResync task resets each timed out counter to the maximum number of credits depending on the current CBFC mode.
- a method has been provided for automatically generating code to define and control a system of hardware elements.
- a switch fabric embodiment of the invention has been presented for illustration. However, the invention is not limited to merely this example. Other variations and embodiments of the invention will occur to those skilled in the art.
Abstract
Description
- This application is a Continuation of a pending application entitled; METHOD FOR AUTOMATICALLY GENERATING CODE TO DEFINE A SYSTEM OF HARDWARE ELEMENTS, invented by Ripa et al., Ser. No. 10/400,380, filed Mar. 26, 2003; which is a Continuation of the following applications:
- SYSTEM AND METHOD FOR SWITCHING VARIABLY SIZED INFORMATION GROUPS, invented by Yun et al., Ser. No. 10/023,266, filed Dec. 14, 2001, now abandoned;
- SYSTEM AND METHOD FOR SIMULTANEOUS DEFICIT ROUND ROBIN PRIORITIZATION, invented by Yun et al., Ser. No. 10/022,673, filed Dec. 17, 2001, now U.S. Pat. No. 7,079,545;
- SYSTEM AND METHOD FOR GRANTING ARBITRATED BIDS IN THE SWITCHING OF INFORMATION, invented by Yun et al., Ser. No. 10/029,581, filed Dec. 20, 2001, still pending;
- SYSTEM AND METHOD FOR HIERARCHICAL SWITCHING, invented by Yun et al., Ser. No. 10/035,835, filed Dec. 24, 2001, now U.S. Pat. No. 7,020,131; and,
- SYSTEM AND METHOD FOR TOLERATING DATA LINK FAULTS IN A PACKET COMMUNICATIONS SWITCH FABRIC, invented by Clovis et al., Ser. No. 10/373,139, filed Feb. 24, 2003, now U.S. Pat. No. 7,352,694. All the above-referenced applications are incorporated herein by reference.
- 1. Field of the Invention
- This invention generally relates to software programming and, more particularly, to a method for automating generating code that defines and controls a system of network-connected hardware elements.
- 2. Description of the Related Art
- Conventionally, software can be generating by using macros to construct calls to a particular interface in the effort of promoting hardware independent software. However, the interfaces so constructed are not configuration independent. If the system hardware connections are modified, the macros must also be modified. This can be very difficult to for a chip vendor to manage as new customers decide to use a chipset of complex programmable devices, especially if the original design team has been redirected to other projects.
- There is industry demand for integrated circuits (ICs) switching systems that can be easily scaled for Network Access, the Network Edge, or a Core Switch Router, at the high end. SCSA (Signal Computing System Architecture) defines a switch fabric to be the facility for connecting any two (or more) transmitting or receiving Service Providers.
-
FIG. 10 is a schematic block diagram of a general switch fabric system (prior art). Traffic enters the system on the ingress side (the left side of the figure). Traffic exits the system on the egress side (the right side of the figure). The port card ingress and egress structures are sometimes subdivided into channels and subchannels. The packet headers specify a required destination port card, channel, and subchannel. The system must synchronously route each ingress packet to the correct egress destination. - Packets are converted into frames by ingress traffic managers (iTMs). A frame is a logical unit of data, which is often a small piece of a much larger data set such as a file or image. The iTMs feed the ingress side of the fabric. The switch fabric might convert the frame format to a “native” format, and then on egress, convert the data back into the TM frame format before sending the data to the egress traffic managers (eTMs). If the frames are fixed size (for example: 53 bytes, 64 bytes, or 80 bytes), the frames are often called cells.
- Protocol Specific vs. Protocol Agnostic
- A switch fabric can be protocol specific or protocol agnostic. An example of a protocol specific switch fabric would be a system designed and optimized specifically for asynchronous transfer mode (ATM) traffic. Another example would be a switch that handles only TCP/IP traffic. The obvious disadvantage of a switch fabric hardwired to handle a specific protocol is lack of flexibility. Service providers want to sell services to a variety of customers in various industries. Protocols vary from industry to industry.
- Even within one protocol type, there can be protocol upgrades. For example, TCP/IP, the machine language of Internet routers, now runs primarily “IPv4.” This protocol, successful as it has been, has a lack of available addresses, poor security features, and no “quality of service” (QoS) provisions. The next generation Internet protocol is “IPv6.” It provides solutions to these limitations.
- A protocol agnostic switch fabric works equally well with all protocol types, however, the traffic manager must be responsible for recognizing specific protocol types. The disadvantage of a protocol agnostic switch fabric is that it may be more complicated, and perhaps slower than a switch fabric dedicated to a particular protocol.
- Packet Striping vs. Single Link per Packet
- The simplest way for a traffic manager to transmit a packet into a switch fabric is to transmit the packet serially along one line. Striping is a way of achieving higher bandwidth by transmitting a single packet across multiple ingress/egress lines. For example, a TM can transmit a packet into a switch fabric eight times as fast if the packet is sliced into eight pieces (stripes) by the TM, and conveyed into the fabric along 8 parallel lines simultaneously. The fabric captures the packet in memory, routes it to the required egress destination, and slices the packet into 8 parallel lines before transmitting the packet to the egress TM.
- The upside to packet striping is the potential for lower latency. There are several negative aspects of packet striping:
- if one of the links is damaged (1 of 8 in the example above), the entire channel is out of service, degrading fault tolerance; and,
- the interface between the TM and switch fabric is more complicated. Circuitry must be used to slice the packet into stripes and reassemble it into packets.
- Single-Cell Packet vs. Multi-Cell Packets
- Many switch fabrics now deployed and passing revenue traffic, especially in wide area networks (WANs), use asynchronous transfer mode (ATM) packets. ATM packets are single-cell packets, with a fixed cell size of 53 bytes, 48 bytes of which is the information payload. The ATM specification evolved in the 1980s and early 1990s. It was then believed that variable length (multi-cell) packets would be too difficult to implement at rates needed for wire-speed traffic. The single-cell solution was a compromise that would work for voice data, video data, multimedia data, email data, file data, etc. With a fixed frame size, switch designs are simplified and ultimately faster.
- However, files are better sent in large frames. Voice switching performs better with small bursts of data, corresponding to analog-to-digital converter time slots. Large frames and concomitant switching latencies can render a switch useless for most 2-way voice applications. Voice communications require low latency (time delay). Since ATM had to work for all network data, the small payload (voice) requirements prevailed at the expense of the large frame applications.
- For large frames or packets it is much more efficient to establish a path from an ingress port card to the required egress destination, and then leave this path undisturbed until the packet is completed. With single cell packets, the ingress port card must bid for, accept grants, and then schedule each cell of a multi-cell packet.
- There are also Frame Relay switch fabrics. Frame Relay is a single-cell protocol, albeit with frame size ranging from 6 to 4096 bytes. Such switch fabrics have been deployed and passing revenue traffic since the early 1990s. These switch fabrics have generally not been used for voice data because of the large latency. Only highly compressed voice traffic works well over frame relay. Voice-over-frame relay was added as an afterthought by network engineers. Frame relay excels at data communications such as local area network internetworking (LAN-to-LAN). Such communications are very high speed and bursty, with non-critical latency constraints.
- Cut-Through vs. Store-and-Forward
- The conventional method of switch fabric packet routing is called Store-and-Forward. In this method, the switch fabric accepts an input packet and buffers the packet on the ingress side of the fabric, making sure the packet was received intact, knowing the exact number of cells in the packet. The problem with the store-and-forward method is the added latency of buffering the packet. In Cut-through Packet Routing (CPR), a switch fabric is able to send the incoming packet cells to the correct egress port as soon as the destination address is known.
- Memory-Based vs. Arbitrated Crossbar
- A switch fabric can use memory-based crossbars or arbitrated crossbars. A memory-based crossbar is sometimes called a “shared memory switch.” Ingress packets flow from the port cards into a huge memory bank, which serve as the switch. From the memory bank, the destination address is determined from egress port destination information in the cell headers. The problem with these switch fabrics is that they become prohibitively expensive and large from all the required high-speed memory. Such fabrics cannot be used to reach terabit total switching speeds with technology available today.
- It would be advantageous if new firmware executable code could be easily created for new customers by field application engineers (FAEs). Preferably, such code generation could occur without the need for delving into the finer details of the firmware, knowing the chipset register definitions, or modifying the source code. If the firmware generation process could be highly automated, customers could even learn how to deploy a wide variety of system configurations themselves, with little FAE support, after receiving training for the chipset and its firmware environment.
- It would be advantageous to deploy a new system by running a graphical user interface (GUI) on a workstation, with the GUI prompting the user(s) through a process that automatically defines the form and function of the system, without the usual arduous (and expensive) programming. Using “drag and drop” mouse commands, pull down menus, and icons, the customer or FAE could create a completely new firmware build customized for a completely new hardware configuration.
- It would be advantageous if the maintenance of the system firmware could be focused on the code generation system as well as the algorithmic code, without the drudgery of “starting from scratch” for each new system or customer.
- A good example of a candidate chipset for employing the method described above is the Cyclone Switch Fabric. This set of four chips has thousands of registers and 100's of millions of logic gates. A huge and steep learning curve must be overcome for even the most seasoned firmware engineer to master the multiplicity of register settings, system configuration options, and complex algorithms used in the firmware. It would be advantageous of the Cyclone chipset firmware can developed for new systems with the help of automated tools.
- It would be advantageous if the automatic system definition process could also be applied to a broader range communications chipsets. Other examples chipsets might include framers, media access controllers (MACs), PHY devices (used in the OSI Physical layer), Physical Medium Dependent (PMD) devices, framers, network processors, and traffic managers. All such devices have registers, which must be loaded to configure the devices and registers, which must be read to monitor the health and status of the devices. All such devices also must be connected together in a specific manner in a newly proposed system (the form of the system). And all such devices have a multiplicity of parameter selections (the function of the system). The system engineer, solutions architect, or FAE could use the automated firmware tools on customer visits to propose new solutions to customer needs.
- A method is provided for automatically generating code to define and control a system of connected hardware elements. The method comprises: accepting a system configuration macro with sub-macros for system elements, subsystem elements, and connections there between; accepting a plurality of tables with a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options; defining the system of connected elements in response to selecting sub-macros; defining the physical links between the system elements and the behavior of the system and subsystem elements in response to populating the selected sub-macro parameters; expanding the selected sub-macros; generating executable code; and, accessing the tables in response to parameters in the executable code. Alternately stated, the expansion of the sub-macros defines the form and the function of the network hardware, with programming.
- Additional details of the present inventions methods are provided below.
-
FIG. 1 a is a flowchart illustrating the present invention method for automatically generating code to define and control a system of connected hardware elements. -
FIG. 1 b illustrates specifics relating toSteps FIG. 1 a. -
FIG. 2 is a flowchart illustrating the present invention method for automatically generating code to define and control a switch fabric of connected cards. -
FIG. 3 is a flowchart illustrating another aspect of the present invention method for automatically generating code to define and control a system of connected hardware elements. -
FIG. 4 is a diagram illustrating the hierarchy of the system configuration file. -
FIG. 5 is an illustration of code that is generated for each macro in the Systemconfiguration.cfg file. -
FIG. 6 illustrates the relationship between configuration files and configuration tables. -
FIG. 7 depicts an excerpt of a PQ chip configuration file. -
FIG. 8 illustrates how the configuration file is indexed, to locate the tables that contain the values to program into the chip registers for a given chip configuration mode. -
FIG. 9 is a flowchart illustrating the present invention method for autonomously discovering the configuration of system-connected elements. -
FIG. 10 is a schematic block diagram of a general switch fabric system (prior art). -
FIG. 1 a is a flowchart illustrating the present invention method for automatically generating code to define and control a system of connected hardware elements. Although the method (and methods associated withFIGS. 2 and 3 below) is depicted as a sequence of numbered steps for clarity, no order should be inferred from the numbering unless explicitly stated. It should be understood that some of these steps may be skipped, performed in parallel, or performed without the requirement of maintaining a strict order of sequence. The method starts atStep 100. - Step 102 generates a system configuration macro. Step 104 generates tables defining a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options.
-
FIG. 1 b illustrates specifics relating toSteps FIG. 1 a. In some aspects,Steps - Step 106 accepts the system configuration macro with sub-macros for defining system elements, subsystem elements, and connections there between. Step 108 selects sub-macros. Step 110 populates parameters in the selected sub-macros. Step 112 accepts the plurality of tables defining a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options. Step 114 expands a plurality of sub-macros with populated parameters. In some aspects,
Step 114 expands the parameters of the selected sub-macros. Step 116 generates executable table indexing code. For example, the code can be generated by means of a complier specific to the target processor. Step 118 elaborates the executable code. Step 120 accesses the tables in response to parameters in the executable code. The above-mentioned steps describe the steps that a user would perform to define, compile, and run the code. - In some aspects of the method, elaborating the executable code in
Step 118 includes differentiating the executable code into code sections corresponding to system and subsystem elements. Then, accessing the tables in response to the parameters in the executable code inStep 120 includes loading accessed tables into corresponding subsystem element memories. - In other aspects, accepting the system configuration macro with sub-macros for defining system elements, subsystem elements, and the connections there between, in
Step 106, includes accepting a hierarchical set of fields, with subsystem elements being indentured to system elements. Then, accessing the tables in response to the parameters in the executable code inStep 120 includes substeps. Step 120 a accesses a sub-table in response to indexing a table. Step 120 b loads values from the sub-table in chip registers. - In some aspects, expanding the plurality of sub-macros with populated parameters in
Step 114 includes generating C++ language code. Then, generating executable code inStep 116 includes generating machine code. - To better illustrate the invention, the above-mentioned steps can be understood as a process of configuring a switch fabric of cards including firmware-enabled chips. Then, accepting the system configuration macro with sub-macros for defining system elements, subsystem elements, and the connections there between, in
Step 106 includes accepting a switch fabric configuration macro for defining switch fabric cards, firmware processing integrated circuits (chips) on the cards, and the connections between the cards. Further,Step 106 may include accepting sub-macros to hierarchically define the system level (slot number), the slot level (card type), card level (chip type), and chip level (link types and endpoint). - In some aspects, accepting sub-macros to hierarchically define the system level, the slot level, card level, and chip level, (Step 106) includes differentiating at the slot level between port cards to manage traffic flow in and out of the switch fabric, and switch cards to manage backplane traffic flow between the port cards. In other aspects,
Step 106 includes differentiating at the port card level between memory subsystems (MSs) and queuing/scheduling (QS) devices. In yet other aspects,Step 106 includes differentiating at the switch card level between arbiter and crossbars. Further,Step 106 may include defining MS chip level data link connections. - Defining MS chip level data link connections may further include defining input port card ingress data links, backplane data links, and output port card egress data links. In other aspects, accepting sub-macros to hierarchically define the system level, the slot level, card level, and chip level, in
Step 106 includes defining PQ chip level control link connections. That is, defining grant/bid control links between input port card ingress QS devices and switch card arbiters and defining grant/bid control links between output port card ingress QS devices and switch card arbiters. - In other aspects, accepting sub-macros in
Step 106 includes defining the chip level. Then, accessing the tables in response to parameters in the executable code inStep 120 includes accessing tables to define chip default register settings and chip modes. - Some aspects of the method include further steps.
Step 122, following the elaboration of the executable code, monitors system performance. Step 124 compares the system performance to a standard. The standard may be that the data and/or control links merely interface. Alternately, the standard may be a bit error rate, for example, or an information bandwidth.Step 126, in response to sub-standard system performance: automatically repopulates selected parameters in the selected sub-macros; accesses tables in response to the repopulated parameters; and, instantiates new executable code. Note,Step 122 through 126 may be preformed iteratively until a minimum level (the standard) of system performance is obtained. In other aspects, the method may shut to system down if a minimum level of performance is not (eventually) achieved. -
FIG. 2 is a flowchart illustrating the present invention method for automatically generating code to define and control a switch fabric of connected cards. The method starts atStep 200. Step 202 accepts a system configuration macro with sub-macros for defining switch cards, port cards, integrated circuits (chips) on the cards, and the connections there between. Step 204 accepts a plurality of tables defining a plurality of card behaviors, a plurality of chip behaviors, and a plurality of connection options. Step 206 selects sub-macros. Step 208 populates parameters in the selected sub-macros. Step 210 expands the selected sub-macros. Step 212 generates executable code. Step 214 elaborates the executable code.Step 216, followingStep 214, indexes the tables in response to the populated parameters. - In some aspects, elaborating the executable code in
Step 214 includes differentiating the executable code into code sections corresponding to cards and chips. Then, indexing the tables in response to calling the parameters (Step 216) includes loading accessed tables into corresponding card chip memories. - In other aspects,
Step 218, following the elaboration of the switch fabric with the executable code, monitors switch fabric performance. Step 220 compares the switch fabric performance to a standard. Step 222, in response to sub-standard switch fabric performance: automatically repopulates selected parameters in the selected sub-macros; indexes tables in response to the repopulated parameters; and, instantiates new executable code. -
FIG. 3 is a flowchart illustrating another aspect of the present invention method for automatically generating code to define and control a system of connected hardware elements. The method starts atStep 300. Step 302 accepts a system configuration macro with sub-macros for system elements, subsystem elements, and connections there between. Step 304 accepts a plurality of tables with a plurality of system element behaviors, a plurality of subsystem element behaviors, and a plurality of connection options. Step 306 defines the system of connected elements in response to selecting sub-macros. Step 308 defines the physical links between the system elements and the behavior of the system and subsystem elements in response to populating the selected sub-macro parameters. Step 310 expands the selected sub-macros. Step 312 generates executable code. Step 314 accesses the tables in response to parameters in the executable code. -
FIG. 9 is a flowchart illustrating the present invention method for autonomously discovering the configuration of system-connected elements. The method starts atStep 400. Step 402 initially populates parameters in a macro. In some aspects, the macro is populated with default parameters. Step 404 elaborates table indexing executable code. Step 406 compares the system performance to a standard.Step 408, in response to sub-standard system performance: automatically repopulates parameters in the macro; indexes tables in response to the repopulated parameters; and, instantiates new table indexing executable code. - The present invention methods use C++ macros to define the physical configuration of a multi processing packet switch fabric system in a hierarchical manner that includes automatic code generation and chip register programming.
- The System Configuration File is a human-readable configuration file and a C++ source file containing C++ macros combine to expand into executable code that forms the run-time implementation of the a packet switch fabric system, for example. The system configuration file is a human-readable text file that defines the hardware layout in its entirety, and performs initial programming of the chips for a discovered hardware configuration.
-
FIG. 4 is a diagram illustrating the hierarchy of the system configuration file. The format of the configuration file is itself hierarchical, indentured to reflect higher and higher specificity of the system. The firmware actively monitors the health of control and data links between switch chips and adjusts data and control paths dynamically to maintain optimum performance levels. This includes automatic re-assignment of control links and addition or removal of data links. Multiple levels of control performance is supported if the number of control links limits credit bandwidth, automatically switching to dual-credit mode to preserve credit bandwidth. - The present invention method is different from conventional system configuration macros in that the form and function of an entire physical subsystem is described and defined in a text file consisting of C++ language macros and hierarchical data tables. Typically, a conventional Element Management System (EMS) maintains a provisioning database that describes cross-connect configurations, equipment and facility states. Various layers of system code use this database to program the hardware. The physical configuration of the system is opaque to this software. The physical layout, connectivity is manifest only when viewed by an operator through the use of a graphical user interface (GUI) that creates a diagram, or as a result of a report output.
- The present invention system configuration file and tables makes the firmware agnostic of the complete subsystem, enabling it to autonomously reconfigure itself based on its own discovery. A complex system is modeled as a hierarchy of autonomous subsystems managed by a high-level communication protocol. The approach is also flexible; practically every physical parameter of the system is captured in the configuration tables. For ease of use, human-readable macro text is pre-processed, not interpreted. Therefore, any ANSII C++ preprocessor can process it. A special program is not required for interpretation, as an interpreter need not be created to process the file. The invention is useful in that the tables that drive the configuration file can be used as input to a GUI that can graphically diagram how the system is configured both physically and functionally. That is, the combination of system configuration file and the tables completely describe both the physical and functional aspects of the switch subsystem.
- The present invention method is enabled, in one specific embodiment, as the Cyclone Firmware Subsystem (CFS) System Configuration mechanism, that encapsulates the form and function of an entire physical Cyclone Switch Subsystem (CSS) in a text file consisting of C++ language macros and hierarchical data tables.
- The configuration system is key to ease of use and flexibility, capturing every physical parameter of the CSS in human-readable tables and macros that can be processed by any ANSII C++ preprocessor to generate the code required to run on any variant of a Cyclone switch system. No special interpreters or proprietary pre-processors are required. The CFS configuration mechanism is not hardware independent, but configuration independent, meaning the CFS can re-program the Cyclone chips to accommodate all possible system configurations.
- The configuration table approach to system programming is more useful than modifying source code because the tables can alternatively serve as input to a Graphical User Interface (GUI) tool that generate a picture of the system, graphically diagramming how the system is configured, both physically and functionally.
-
-
- API Cyclone Firmware Subsystem Application Programming Interface—The API is provided as a means for software on the system controller, or “Host”, to communicate with the Cyclone Firmware Subsystem.
- CFS Cyclone Firmware Subsystem—CFS refers to the entire collection of firmware that represents the a standalone subsystem that controls the operation of the Cyclone switch hardware. A major sub-component of the CRF is the Token Bus Driver, which is a layer of software that handles the low-level, OS and hardware-dependent read and write operations on the token bus.
- CSS Cyclone Switch Subsystem—CSS refers to all of the hardware and firmware that makes up a complete Cyclone packet switch fabric. The CSS consists of the Cyclone chips on various port cards and switch cards that comprise the hardware and the firmware that operates on those chips. The CSS is the only context that includes the concept of hardware, all other terms that remain refer to firmware entities.
- Configuration table module: a programming abstraction of the compile-time configuration class and run-time configuration table object that is encapsulated as a manageable entity, dependent only upon its interface and not implementation. The configuration table module is addressed through the configuration table module API.
- Configuration table class: compile-time definition of the structure, form, properties and methods (functions) of a configuration table object.
- Configuration table object: run-time instantiation of a configuration table class, or variable of type “ConfigTable”. The configuration table object includes the configuration table and the methods that operate upon the table.
- Configuration file: a build-time entity, the configuration file contains the macro definitions that, when elaborated (run, or executed) create the methods that execute upon the data in the configuration table. In Release 1.0 of the firmware, the configuration file name is “SystemConfiguration.cfg”.
- Configuration table: a run-time entity, the configuration table is the RAM-resident aggregation of data tables that define the Cyclone fabric subsystem configuration, and the values contained in every chip register contained in the system.
- This section describes the purpose, structure and function of the configuration table module. The Configuration Table Module consists of the system configuration files and associated methods. This architectural feature of the CFS abstracts the entire Cyclone switch fabric into one central configuration file. The configuration table allows a complete Cyclone fabric subsystem to be defined and modified without the need to re-program, greatly simplifying the system management overhead required to provision, monitor and upgrade the packet fabric subsystem.
- The SystemConfiguration.cfg file contains macros that describe the hardware configuration to the Cyclone firmware. The macros expand into object code that executes on the switch card CPU. For example the SWITCH_CARD macro will be replaced by code that, upon execution (elaboration), will instantiate a switch_Card object. The System Configuration File is a human-readable configuration file and a C++ source file containing C++ macros combine to expand into executable code that forms the run-time implementation of the Cyclone packet switch fabric system. It defines the hardware layout in its entirety, and performs initial programming of the cyclone chips for a discovered hardware configuration. The format of the configuration file is itself hierarchical, indentured to reflect higher and higher specificity of the system.
-
FIG. 5 is an illustration of code that is generated for each macro in the Systemconfiguration.cfg file. The left side of the page shows the macro lines in the SystemConfiguration.cfg file, and the right side shows the code that gets generated in SystemConfiguration.cpp (actually, SystemConfiguration.cfg is included at the SystemConfiguration.cpp source file, but broken out as a separate file for clarity). - Data for the Configuration Table is accumulated from the header files listed below:
- SystemConfiguration.cfg: as described above, provides the initial overall slot layout that defines which card type occupies what slot and what chips are configured on each card. The macros in this file are expanded into code by the compiler to make up methods in the ConfigTable object. At startup, these methods verify the hardware configuration, and read values from the tables described below, to program the Cyclone chips on the cards that are found.
- The System Configuration file “SystemConfiguration.cfg” is modified by the system designer at build time to reflect the hardware layout of the Cyclone fabric. The contents are used at compile time to generate methods that make up the Configuration Table object, which is instantiated at run time to verify the hardware configuration and to pro-gram default values into the chips. The configuration information and the class methods that operate upon this information are included in the boot image that is present in the persistent store of the primary switch card (either hard disk, or some type of EPROM). A configuration table can also be downloaded to the primary card from the host during startup.
- For each chip, in addition to the chip ID, there are three “modes” which are numbers that point to a section in the register tables. For each chip type there is a set of four register tables. The first table is simply a base table that contains an initial value for each register. The other three tables contain the mode specific values, and these tables are used to modify the base tables at runtime (i.e. the relevant entries in the mode tables are merged with the base tables). At runtime, the firmware starts with a copy of the base tables and successively merges in the appropriate entries from the other tables. The final result is programmed in the chips. The following header files contain tables that are hierarchical, with the first configuration file having the broadest scope for a particular chip type, and successive files having more resolution into the settings of individual chips.
-
- ScBaseRegs_<chip_type>.h provide default settings for all chips of chip_type. These files are loaded first, and define the list of base or default registers settings for all the registers for a chip-type. All tables loaded after this are intended to be changes to this base configuration.
- ScSysConfigRegs_<chip_type>.h provide the system level configuration modes per chip type. These files define the register settings based on a predefined system configuration. A chip's system configuration table has a number of modes that can be selected based on the system platform.
- ScChipConfigRegs_<chip_type>.h provide the chip level configuration modes. These files define the register settings for individual chips of a particular chip-type within the system. The assignment of chip configuration modes within this table is intended to vary among chips of the same chip-type within a system according to system location.
- ScCustomPrefRegs_<chip_type>.h provide custom chip level configuration modes. These files are used to define specific register settings that need to be modified from previously loaded tables. CustomPrefRegs_<chip-type>.h files define the tables of register settings that differ or that are not set in the base, system configuration, or chip configuration tables. These files provide the proper mechanism of adding or overriding register settings specified by the base, system configuration, or chip configuration tables.
-
FIG. 6 illustrates the relationship between configuration files and configuration tables. - Self healing is a process by which the firmware dynamically changes system configurations to overcome system failures. Once corrected, the system brings itself back to a new “standard” of performance. In performing self healing, the firmware monitors the health of control and data links between switch chips and dynamically re-routes data and control information when links fail, in order to maintain optimum performance levels. Data and control traffic loading is also re-balanced when cards are inserted or removed from the system. Multiple levels of control performance is supported if the number of control links limits credit bandwidth, automatically switching to dual-credit mode to preserve credit bandwidth. The mode changes are the result of selecting different mode tables and re-programming the chip registers with values from those tables.
- One aspect of Self Healing is Load Balancing. In the example system of the Cyclone Switch Fabric, Load Balancing would equally balance the “load” of port cards being configured and monitored by a processor on a switch card. Each such processor, through its dedicated Arbiter, can supervise up to 32 port cards. But if there are four working switch cards in the system, each processor would supervise 8 port cards in a load-balanced system. If one switch card were then to fail, the self healing firmware would detect this failure, and a load balancing routine might reallocate ports to switch cards such that 11 port cards are each supervised by
switch cards switch card 3. - Overview of the Cyclone Firmware relating to Load Balancing
- The Cyclone firmware is a collection of task objects that execute on the switch card CPUs. Communicating through a TCP/IP connection, the Cyclone firmware can be controlled by any host processor through a supplied Application Programming Interface (API). Configurable entirely through the use of configuration files, the Cyclone firmware is a distributed system providing fault-tolerant control of up to 16 switch cards and 32 port cards to program, monitor and control the Cyclone chips in a Cyclone switch fabric system. Typically, a switching subsystem contains multiple, intelligent switch cards that are connected through an internal network in a loosely coupled fashion.
- A Cyclone Switch Subsystem (CSS) is generally distributed among the port cards and the switch cards. The port cards contain input and output queue chips (8505 iPQ and oPQ, 8805 EDFQ) and memory subsystem chips (8905 iMS and eMS). The switch cards contain an Arbiter (8605) and up to five Crossbar chips (Arbiters and Crossbars are both 8605 parts but are configured by a jumper to operate in either Arbiter or Crossbar mode). Included in the CSS is a controlling CPU that is resident on every switch card.
- The firmware provides the capability to resynchronize individual credit counters in the PQ chips on a periodic basis, or on-demand in case errors are detected by the firmware. The firmware will re-synchronize the appropriate flow control counters of those particular ports for which an error was detected. Typically, credit resync is the result of detecting a status flag set by the S8605 Arbiter chip, indicating either a soft or permanent link error, or by the system detecting that a switch card has failed. If a credit-carrying control link goes down, the link will be re-assigned and the credit counters resynchronized.
- The failure of a control link between an Arbiter and PQ indicates to the firmware that backplane tokens cannot be reliably communicated over the failed link. The port card may need to be managed by a different switch card in order to re-establish connectivity to the chips on the port card. Once the self healing is complete, the BP_CBFC configuration of the switch may need to be updated. To update the BP_CBFC configuration, the register settings of the appropriate Arbiter chips must be updated, followed by those on the MS chips, and ultimately those on the PQ chips. Reconfiguration of the control links is performed by selecting an appropriate map from the PQ chip configuration file.
-
FIG. 7 depicts an excerpt of a PQ chip configuration file. In response to changing hardware conditions, e.g., a control link failure or a swapped-out switch card, the firmware will scan its configuration tables in the file ScChipConfigRegs_PQ_I.h to determine the next best-fit credit resync configuration. The configuration file contains register settings for the different Cyclone configurations. The “mode” field is used to index into the configuration file to select register maps for a given mode. The mode field is made up of subfields that include credit mode and credit mask settings. - The “Chip Configuration Mode” is used as an index into the configuration tables to select the appropriate tables containing the chip register values for a given Chip Configuration Mode. The “Family Mask” defines alternate configurations to support load balancing and self healing. Family Mask is combined with Chip Configuration Mode to find compatible modes for alternate credit transmission/reception. The search is done in the order that the various configurations occur in the configuration file, with the most optimal configurations occurring first, followed by less optimal configurations. At some point the number of links becomes small enough to change the credit mode to “dual” mode, so that each credit returned to an iPQ is counted as two credits, to halve the number of credits that are needed to keep the switch running.
-
FIG. 8 illustrates how the configuration file is indexed, to locate the tables that contain the values to program into the chip registers for a given chip configuration mode. - When the firmware detects a control or data link error during polling, it sends an internal system error message to the system error handler on the primary switch card. At the same time, an error message is sent to the user. The system error handler reconfigures the switch when it receives a control link failure error and, synchronizes the credit counters of all PQ's when it receives a data link failure error.
- The failure of a control link between an Arbiter and PQ indicates to the firmware that tokens cannot be reliably communicated over the failed link. The port card may need to be managed by a different switch card in order to re-establish connectivity to the chips on the port card (this is referred to as self healing from the Firmware perspective, as opposed to load balancing from the switch's perspective, which balances cell traffic load among the available links). Once the load balancing is complete, the Credit Based Flow Control (CBFC) configuration of the switch may need to be updated. To update the CBFC configuration, the register settings of the appropriate Arbiter chips updated, followed by those on the MS chips, and ultimately those on the PQ chips.
- The self healing Process does the following:
-
- 1. Disables polling.
- 2. Disables the configuration table access on all XbarCard tasks.
- 3. Distributes the available port cards among the running switch cards based on the available (error-free) Arbiter to PQ control links.
- 4. Re-enables access to the configuration table on all XBarCard tasks.
- 5. Distributes the register store based on the new port card distribution.
- 6. Computes and selects a new primary Arbiter chip and switch card.
- 7. Computes and selects a new primary PQ chip, port id and port card.
- 8. Computes the next CBFC configuration to use.
- 9. Disables CBFC.
- 10. Configures the Arbiter chips with the new CBFC configuration.
- 11. Configures the MS chips with the new CBFC configuration.
- 12. For each PQ chip, configures and enables the new CBFC configuration.
- 13. Distributes the updated register store to the switch cards.
- 14. Re-enables polling.
Data Link Failure from Ingress TM to Ingress MS
- Data link failures are detected on the receive side of the ingress MS during register polling. The Host is notified of these failures. A data link failure detected on the receive side of the ingress MS indicates that there's an error on the data link between the traffic manager and the iMS. The firmware has a map of how the TM links map between the ingress MS and egress MS chips. Using this map, the system error handler will disable the data link in the eMS “Output Link Enable” bit mask that corresponds to the failed data link detected by the ingress MS.
- Data Link Failures from Ingress MS to Crossbar
- Data link failures are detected on the receive side of the Crossbar during register polling. The Host is notified of these failures.
- Each link is monitored for 8B/10B violations, frame misalignment, byte misalignment, loss of CDR lock, and FIFO overflow/underflow. When the link error threshold is exceeded for a link, the Crossbar will initiate a report to the Arbiter over the token bus. The result is that the Arbiter will no longer grant transmissions over that link. An idle cell is automatically generated by the Crossbar for those outputs that have no corresponding valid input. The errored link is detected during register polling and the Host is notified. Disabling a link reduces switch performance and should be cause for removal of the offending card(s).
- Data Link Failure from Crossbar to Egress MS
Data link failures are detected on the receive side of the egress MS (from backplane or another MS) during register polling. The Host is notified of these failures. Failed backplane links between the Crossbar and receiving eMS are communicated to the iPQ on the same port card by the MS2PQ_LINK_FC signal, which communicates all receive link status in round robin order. Once the iPQ gets a failed link notification, it passes the information to the Arbiter during bids (byte-7, bit-1) so that the Arbiter will stop using that link to grant connections to the respective egress port and channel (and subchannel). - The iPQ indicates a credit counter timeout “error” in
bit 2 of its High Priority Message register (register 254). The error is detected by a polling task, which reports it to its local XbarCard task. This task does not report the error to the user nor to the system error handler task. Instead, the XBarCard task intercepts the error and sends the NOT_SYNCH_TIMED_OUT_COUNTERS message to the local CreditResync task. The local CreditResync task detects which specific counter or counters have timed out by reading the timed out counters bit mask from the iPQ. The CreditResync task resets each timed out counter to the maximum number of credits depending on the current CBFC mode. - A method has been provided for automatically generating code to define and control a system of hardware elements. A switch fabric embodiment of the invention has been presented for illustration. However, the invention is not limited to merely this example. Other variations and embodiments of the invention will occur to those skilled in the art.
Claims (12)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/103,683 US20080256455A1 (en) | 2001-12-14 | 2008-04-15 | Method for Defining the Physical Configuration of a Communication System |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US2326601A | 2001-12-14 | 2001-12-14 | |
US10/022,673 US7079545B1 (en) | 2001-12-17 | 2001-12-17 | System and method for simultaneous deficit round robin prioritization |
US10/029,581 US7424013B1 (en) | 2001-12-20 | 2001-12-20 | System and method for granting arbitrated bids in the switching of information |
US10/035,835 US7020131B1 (en) | 2001-12-24 | 2001-12-24 | System and method for hierarchical switching |
US10/373,139 US7352694B1 (en) | 2001-12-14 | 2003-02-24 | System and method for tolerating data link faults in a packet communications switch fabric |
US10/400,380 US8418129B1 (en) | 2001-12-14 | 2003-03-26 | Method for automatically generating code to define a system of hardware elements |
US12/103,683 US20080256455A1 (en) | 2001-12-14 | 2008-04-15 | Method for Defining the Physical Configuration of a Communication System |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/400,380 Continuation US8418129B1 (en) | 2001-12-14 | 2003-03-26 | Method for automatically generating code to define a system of hardware elements |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080256455A1 true US20080256455A1 (en) | 2008-10-16 |
Family
ID=38690995
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/373,139 Active 2024-09-19 US7352694B1 (en) | 2001-12-14 | 2003-02-24 | System and method for tolerating data link faults in a packet communications switch fabric |
US10/395,367 Expired - Fee Related US7304987B1 (en) | 2001-12-14 | 2003-03-24 | System and method for synchronizing switch fabric backplane link management credit counters |
US10/403,964 Expired - Fee Related US7298754B1 (en) | 2001-12-14 | 2003-03-31 | Configurable switch fabric interface bandwidth system and method |
US10/403,979 Expired - Fee Related US7298756B1 (en) | 2001-12-14 | 2003-03-31 | System and method for programming cell packet headers |
US12/103,683 Abandoned US20080256455A1 (en) | 2001-12-14 | 2008-04-15 | Method for Defining the Physical Configuration of a Communication System |
US12/105,218 Expired - Fee Related US7965624B2 (en) | 2001-12-14 | 2008-04-17 | Data link fault tolerance |
Family Applications Before (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/373,139 Active 2024-09-19 US7352694B1 (en) | 2001-12-14 | 2003-02-24 | System and method for tolerating data link faults in a packet communications switch fabric |
US10/395,367 Expired - Fee Related US7304987B1 (en) | 2001-12-14 | 2003-03-24 | System and method for synchronizing switch fabric backplane link management credit counters |
US10/403,964 Expired - Fee Related US7298754B1 (en) | 2001-12-14 | 2003-03-31 | Configurable switch fabric interface bandwidth system and method |
US10/403,979 Expired - Fee Related US7298756B1 (en) | 2001-12-14 | 2003-03-31 | System and method for programming cell packet headers |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/105,218 Expired - Fee Related US7965624B2 (en) | 2001-12-14 | 2008-04-17 | Data link fault tolerance |
Country Status (1)
Country | Link |
---|---|
US (6) | US7352694B1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070055794A1 (en) * | 2005-09-07 | 2007-03-08 | Willy Chuang | System and method for modifying firmware of an optical storage medium device without requiring a compiling process |
US20110084977A1 (en) * | 2009-10-13 | 2011-04-14 | Duluk Jr Jerome Francis | State shadowing to support a multi-threaded driver environment |
US20120072701A1 (en) * | 2009-10-16 | 2012-03-22 | Duluk Jr Jerome Francis | Method Macro Expander |
US8418129B1 (en) | 2001-12-14 | 2013-04-09 | Qualcomm Incorporated | Method for automatically generating code to define a system of hardware elements |
US20130191569A1 (en) * | 2012-01-25 | 2013-07-25 | Qualcomm Incorporated | Multi-lane high-speed interfaces for high speed synchronous serial interface (hsi), and related systems and methods |
Families Citing this family (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8847696B2 (en) * | 2002-03-18 | 2014-09-30 | Qualcomm Incorporated | Flexible interconnect cable having signal trace pairs and ground layer pairs disposed on opposite sides of a flexible dielectric |
US7336139B2 (en) * | 2002-03-18 | 2008-02-26 | Applied Micro Circuits Corporation | Flexible interconnect cable with grounded coplanar waveguide |
US7590135B2 (en) * | 2002-12-30 | 2009-09-15 | Intel Corporation | Methods and apparatus to perform security related operations on received signals |
US20050089054A1 (en) * | 2003-08-11 | 2005-04-28 | Gene Ciancaglini | Methods and apparatus for provisioning connection oriented, quality of service capabilities and services |
US7539143B2 (en) * | 2003-08-11 | 2009-05-26 | Netapp, Inc. | Network switching device ingress memory system |
US7573826B1 (en) * | 2004-06-22 | 2009-08-11 | Nortel Networks Limited | Darwinian network |
US8204064B2 (en) * | 2005-09-16 | 2012-06-19 | Acme Packet, Inc. | Method and system of session media negotiation |
US7568064B2 (en) * | 2006-02-21 | 2009-07-28 | M2000 | Packet-oriented communication in reconfigurable circuit(s) |
US20080162855A1 (en) * | 2006-12-29 | 2008-07-03 | Tessil Thomas | Memory Command Issue Rate Controller |
US7864794B2 (en) * | 2007-10-12 | 2011-01-04 | Broadcom Corporation | Method and system for managing an energy efficient network utilizing audio video bridging |
US7974278B1 (en) | 2007-12-12 | 2011-07-05 | Integrated Device Technology, Inc. | Packet switch with configurable virtual channels |
US8830845B2 (en) * | 2008-08-04 | 2014-09-09 | Ciena Corporation | Packet switch modeling and using a packet switch model to test a packet switch |
US7907625B1 (en) | 2008-08-04 | 2011-03-15 | Integrated Device Technology, Inc. | Power reduction technique for buffered crossbar switch |
CN102216321A (en) * | 2008-10-15 | 2011-10-12 | 因特蒙公司 | Therapeutic antiviral peptides |
US8176307B2 (en) * | 2009-04-13 | 2012-05-08 | Broadcom Corporation | Method and system for post-build modification of firmware binaries to support different hardware configurations |
KR101250538B1 (en) * | 2009-06-26 | 2013-04-03 | 한국전자통신연구원 | Ethernet Device and Lane Operation Method |
US8509069B1 (en) * | 2009-12-22 | 2013-08-13 | Juniper Networks, Inc. | Cell sharing to improve throughput within a network device |
WO2012131691A1 (en) * | 2011-03-31 | 2012-10-04 | Tejas Networks Limited | A detachable fabric card |
US9013783B2 (en) | 2011-06-02 | 2015-04-21 | E Ink California, Llc | Color electrophoretic display |
US8856420B2 (en) * | 2011-12-27 | 2014-10-07 | Intel Corporation | Multi-protocol I/O interconnect flow control |
US9383623B2 (en) | 2013-05-17 | 2016-07-05 | E Ink California, Llc | Color display device |
EP2997568B1 (en) | 2013-05-17 | 2019-01-09 | E Ink California, LLC | Color display device |
TWI534520B (en) | 2013-10-11 | 2016-05-21 | 電子墨水加利福尼亞有限責任公司 | Color display device |
ES2793903T3 (en) | 2014-01-14 | 2020-11-17 | E Ink California Llc | Procedure for activating a color display layer |
US20150268531A1 (en) | 2014-03-18 | 2015-09-24 | Sipix Imaging, Inc. | Color display device |
US10380955B2 (en) | 2014-07-09 | 2019-08-13 | E Ink California, Llc | Color display device and driving methods therefor |
US10891906B2 (en) | 2014-07-09 | 2021-01-12 | E Ink California, Llc | Color display device and driving methods therefor |
US10147366B2 (en) | 2014-11-17 | 2018-12-04 | E Ink California, Llc | Methods for driving four particle electrophoretic display |
US9894013B2 (en) * | 2015-02-03 | 2018-02-13 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Early queueing network device |
CN110731070A (en) | 2017-03-29 | 2020-01-24 | 芬基波尔有限责任公司 | Non-blocking arbitrary to arbitrary data center networks with grouped injection via multiple alternate data paths |
US10425707B2 (en) | 2017-03-29 | 2019-09-24 | Fungible, Inc. | Non-blocking, full-mesh data center network having optical permutors |
WO2018183553A1 (en) | 2017-03-29 | 2018-10-04 | Fungible, Inc. | Non-blocking any-to-any data center network having multiplexed packet spraying within access node groups |
US10565112B2 (en) | 2017-04-10 | 2020-02-18 | Fungible, Inc. | Relay consistent memory management in a multiple processor system |
CN117348976A (en) | 2017-07-10 | 2024-01-05 | 微软技术许可有限责任公司 | Data processing unit for stream processing |
WO2019014265A1 (en) | 2017-07-10 | 2019-01-17 | Fungible, Inc. | Data processing unit for compute nodes and storage nodes |
US10965586B2 (en) | 2017-09-29 | 2021-03-30 | Fungible, Inc. | Resilient network communication using selective multipath packet flow spraying |
US10904367B2 (en) | 2017-09-29 | 2021-01-26 | Fungible, Inc. | Network access node virtual fabrics configured dynamically over an underlay network |
TWI682787B (en) | 2017-11-14 | 2020-01-21 | 美商伊英克加利福尼亞有限責任公司 | Electrophoretic active delivery system including porous conductive electrode layer |
US10540288B2 (en) | 2018-02-02 | 2020-01-21 | Fungible, Inc. | Efficient work unit processing in a multicore system |
US11070474B1 (en) * | 2018-10-22 | 2021-07-20 | Juniper Networks, Inc. | Selective load balancing for spraying over fabric paths |
CN114728155A (en) | 2019-11-27 | 2022-07-08 | 伊英克加利福尼亚有限责任公司 | Beneficial agent delivery system including microcells having galvanic sealing layers |
Citations (94)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5197016A (en) * | 1988-01-13 | 1993-03-23 | International Chip Corporation | Integrated silicon-software compiler |
US5231633A (en) * | 1990-07-11 | 1993-07-27 | Codex Corporation | Method for prioritizing, selectively discarding, and multiplexing differing traffic type fast packets |
US5291479A (en) * | 1991-07-16 | 1994-03-01 | Digital Technics, Inc. | Modular user programmable telecommunications system with distributed processing |
US5422881A (en) * | 1989-06-30 | 1995-06-06 | Inmos Limited | Message encoding |
US5594657A (en) * | 1993-09-27 | 1997-01-14 | Lucent Technologies Inc. | System for synthesizing field programmable gate array implementations from high level circuit descriptions |
US5610745A (en) * | 1995-10-26 | 1997-03-11 | Hewlett-Packard Co. | Method and apparatus for tracking buffer availability |
US5781745A (en) * | 1996-05-20 | 1998-07-14 | 3Com Corporation | High speed communication bus |
US5872904A (en) * | 1991-05-01 | 1999-02-16 | Ncr Corporation | Computer system using a master processor to automatically reconfigure faulty switch node that is detected and reported by diagnostic processor without causing communications interruption |
US5883814A (en) * | 1997-03-13 | 1999-03-16 | International Business Machines Corporation | System-on-chip layout compilation |
US5889779A (en) * | 1996-12-02 | 1999-03-30 | Rockwell Science Center | Scheduler utilizing dynamic schedule table |
US6044061A (en) * | 1998-03-10 | 2000-03-28 | Cabletron Systems, Inc. | Method and apparatus for fair and efficient scheduling of variable-size data packets in an input-buffered multipoint switch |
US6055599A (en) * | 1995-09-11 | 2000-04-25 | Electronics & Telecommunications Research Institute | Hierarchical crossbar interconnection network for a cluster-based parallel processing computer |
US6067286A (en) * | 1995-04-11 | 2000-05-23 | General Datacomm, Inc. | Data network switch with fault tolerance |
US6072772A (en) * | 1998-01-12 | 2000-06-06 | Cabletron Systems, Inc. | Method for providing bandwidth and delay guarantees in a crossbar switch with speedup |
US6073199A (en) * | 1997-10-06 | 2000-06-06 | Cisco Technology, Inc. | History-based bus arbitration with hidden re-arbitration during wait cycles |
US6101193A (en) * | 1996-09-10 | 2000-08-08 | Kabushiki Kaisha Toshiba | Packet scheduling scheme for improving short time fairness characteristic in weighted fair queueing |
US6252853B1 (en) * | 1997-07-24 | 2001-06-26 | Hitachi, Ltd. | Switching router and a datagram transfer system |
US20010010910A1 (en) * | 1998-08-07 | 2001-08-02 | Boston Probes Inc. | Pna probes, probe sets, methods and kits pertaining to the universal detection of bacteria and eucarya |
US6275491B1 (en) * | 1997-06-03 | 2001-08-14 | Texas Instruments Incorporated | Programmable architecture fast packet switch |
US6343081B1 (en) * | 1997-12-30 | 2002-01-29 | International Business Machines Corporation | Method and apparatus for managing contention in a self-routing switching architecture in a port expansion mode |
US20020012344A1 (en) * | 2000-06-06 | 2002-01-31 | Johnson Ian David | Switching system |
US6345040B1 (en) * | 1998-07-30 | 2002-02-05 | Marconi Communications, Inc. | Scalable scheduled cell switch and method for switching |
US6351466B1 (en) * | 1998-05-01 | 2002-02-26 | Hewlett-Packard Company | Switching systems and methods of operation of switching systems |
US20020039351A1 (en) * | 2000-09-29 | 2002-04-04 | Linghsiao Wang | Bandwidth sharing using emulated weighted fair queuing |
US20020039364A1 (en) * | 2000-10-02 | 2002-04-04 | Satoshi Kamiya | Two-dimensional pipelined scheduling technique |
US20020058258A1 (en) * | 1996-06-04 | 2002-05-16 | Wittwer Carl T. | Monitoring hybridization during PCR using SYBR Green I |
US20020061028A1 (en) * | 2000-11-20 | 2002-05-23 | Polytechnic University | Scheduling the dispatch of cells in multistage switches using a hierarchical arbitration scheme for matching non-empty virtual output queues of a module with outgoing links of the module |
US6411599B1 (en) * | 1998-05-29 | 2002-06-25 | International Business Machines Corporation | Fault tolerant switching architecture |
US20020105966A1 (en) * | 2000-11-17 | 2002-08-08 | Ronak Patel | Backplane interface adapter with error control and redundant fabric |
US20020118692A1 (en) * | 2001-01-04 | 2002-08-29 | Oberman Stuart F. | Ensuring proper packet ordering in a cut-through and early-forwarding network switch |
US6490690B1 (en) * | 1999-07-22 | 2002-12-03 | International Business Machines Corporation | Method and apparatus for unix system catastrophic recovery aid |
US6515991B1 (en) * | 1996-06-27 | 2003-02-04 | Cisco Technology, Inc. | Combined unicast and multicast scheduling |
US20030026206A1 (en) * | 2001-07-31 | 2003-02-06 | Mullendore Rodney N. | System and method for late-dropping packets in a network switch |
US20030026267A1 (en) * | 2001-07-31 | 2003-02-06 | Oberman Stuart F. | Virtual channels in a network switch |
US6519540B1 (en) * | 1994-10-04 | 2003-02-11 | Iris Technologies, Inc. | Signal router with cross-point view graphical interface |
US20030031193A1 (en) * | 2001-04-06 | 2003-02-13 | Andrews Daniel M. | Scalable weight-based terabit switch scheduling method |
US20030035427A1 (en) * | 2001-08-14 | 2003-02-20 | Mehdi Alasti | Method and apparatus for arbitration scheduling with a penalty for a switch fabric |
US20030043847A1 (en) * | 2001-08-31 | 2003-03-06 | Haddad Semir S. | Apparatus and method for indexing MPEG video data to perform special mode playback in a digital video recorder and indexed signal associated therewith |
US20030053470A1 (en) * | 2001-09-18 | 2003-03-20 | Divivier Robert J. | Multicast cell buffer for network switch |
US20030058880A1 (en) * | 2001-09-21 | 2003-03-27 | Terago Communications, Inc. | Multi-service queuing method and apparatus that provides exhaustive arbitration, load balancing, and support for rapid port failover |
US6549943B1 (en) * | 1999-06-16 | 2003-04-15 | Cisco Technology, Inc. | Network management using abstract device descriptions |
US20030072326A1 (en) * | 2001-08-14 | 2003-04-17 | Mehdi Alasti | Method and apparatus for parallel, weighted arbitration scheduling for a switch fabric |
US6553026B1 (en) * | 1998-07-09 | 2003-04-22 | Nec Corporation | Communication path switching apparatus, communication path switching method, and computer program product for controlling communication path switching system |
US20030076848A1 (en) * | 2001-04-27 | 2003-04-24 | Anat Bremler-Barr | Weighted fair queuing-based methods and apparatus for protecting against overload conditions on nodes of a distributed network |
US6563837B2 (en) * | 1998-02-10 | 2003-05-13 | Enterasys Networks, Inc. | Method and apparatus for providing work-conserving properties in a non-blocking switch with limited speedup independent of switch size |
US6570873B1 (en) * | 1998-11-13 | 2003-05-27 | Nec Corporation | System and method for scheduling reservation of traffic with priority |
US20030112757A1 (en) * | 2001-12-19 | 2003-06-19 | Thibodeau Mark Jason | System and method for providing gaps between data elements at ingress to a network element |
US6591286B1 (en) * | 2002-01-18 | 2003-07-08 | Neomagic Corp. | Pipelined carry-lookahead generation for a fast incrementer |
US6594695B1 (en) * | 1999-12-08 | 2003-07-15 | Covad Communitions Group, Inc. | Network profiling system |
US6606588B1 (en) * | 1997-03-14 | 2003-08-12 | Interuniversitair Micro-Elecktronica Centrum (Imec Vzw) | Design apparatus and a method for generating an implementable description of a digital system |
US20040030766A1 (en) * | 2002-08-12 | 2004-02-12 | Michael Witkowski | Method and apparatus for switch fabric configuration |
US20040047408A1 (en) * | 2002-09-10 | 2004-03-11 | Ingo Koenenkamp | Data link analyzer |
US6717956B1 (en) * | 2000-03-03 | 2004-04-06 | Luminous Networks, Inc. | Dual-mode virtual network addressing |
US6721273B1 (en) * | 1999-12-22 | 2004-04-13 | Nortel Networks Limited | Method and apparatus for traffic flow control in data switches |
US20040093601A1 (en) * | 2002-11-07 | 2004-05-13 | Quicksilver Technology, Inc. | Method, system and program for developing and scheduling adaptive integrated circuity and corresponding control or configuration information |
US20040153566A1 (en) * | 2003-01-31 | 2004-08-05 | Brocade Communications Systems, Inc. | Dynamic link distance configuration for extended fabric |
US20040161767A1 (en) * | 2002-06-28 | 2004-08-19 | Baldwin Brett R. | Detection and quantification of aromatic oxygenase genes by real-time PCR |
US20040160970A1 (en) * | 1997-08-22 | 2004-08-19 | Avici Systems, Inc. | Methods and apparatus for event-driven routing |
US6781992B1 (en) * | 2000-11-30 | 2004-08-24 | Netrake Corporation | Queue engine for reassembling and reordering data packets in a network |
US6850490B1 (en) * | 1999-10-06 | 2005-02-01 | Enterasys Networks, Inc. | Hierarchical output-queued packet-buffering system and method |
US6871294B2 (en) * | 2001-09-25 | 2005-03-22 | Sun Microsystems, Inc. | Dynamically reconfigurable interconnection |
US6870831B2 (en) * | 2000-05-04 | 2005-03-22 | Pmc-Sierra, Inc. | Flexible, self-aligning time and space switch fabrics |
US6876633B2 (en) * | 1997-10-21 | 2005-04-05 | Intel Corporation | Apparatus and method for computer telephone integration in packet switched telephone networks |
US6882649B1 (en) * | 2000-03-31 | 2005-04-19 | Sun Microsystems, Inc. | Least choice first arbiter |
US6895528B2 (en) * | 2000-08-07 | 2005-05-17 | Computer Network Technology Corporation | Method and apparatus for imparting fault tolerance in a switch or the like |
US6898728B2 (en) * | 2001-09-25 | 2005-05-24 | Sun Microsystems, Inc. | System domain targeted, configurable interconnection |
US6915372B2 (en) * | 2000-08-31 | 2005-07-05 | Tellabs Operations, Inc. | Methods and apparatus for managing traffic through a buffered crossbar switch fabric |
US6990063B1 (en) * | 2000-03-07 | 2006-01-24 | Cisco Technology, Inc. | Distributing fault indications and maintaining and using a data structure indicating faults to route traffic in a packet switching system |
US6999457B2 (en) * | 2000-03-29 | 2006-02-14 | Juniper Networks, Inc. | Arbiter circuit and method of carrying out arbitration |
US7009985B2 (en) * | 1997-01-23 | 2006-03-07 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US7016350B2 (en) * | 2001-02-03 | 2006-03-21 | Xyratex Technology Limited | Data switch and a method for controlling the data switch |
US7020131B1 (en) * | 2001-12-24 | 2006-03-28 | Applied Micro Circuits Corp. | System and method for hierarchical switching |
US7023857B1 (en) * | 2000-09-12 | 2006-04-04 | Lucent Technologies Inc. | Method and apparatus of feedback control in a multi-stage switching system |
US7035212B1 (en) * | 2001-01-25 | 2006-04-25 | Optim Networks | Method and apparatus for end to end forwarding architecture |
US7042842B2 (en) * | 2001-06-13 | 2006-05-09 | Computer Network Technology Corporation | Fiber channel switch |
US7042883B2 (en) * | 2001-01-03 | 2006-05-09 | Juniper Networks, Inc. | Pipeline scheduler with fairness and minimum bandwidth guarantee |
US7050448B2 (en) * | 2000-04-05 | 2006-05-23 | Xyratex Technology Limited | Data switching arbitration arrangements |
US7058057B2 (en) * | 2001-05-01 | 2006-06-06 | Integrated Device Technology, Inc. | Network switch port traffic manager having configurable packet and cell servicing |
US20060127942A1 (en) * | 1999-10-08 | 2006-06-15 | Tore Straume | Particle analysis assay for biomolecular quantification |
US7072295B1 (en) * | 1999-09-15 | 2006-07-04 | Tellabs Operations, Inc. | Allocating network bandwidth |
US7075990B2 (en) * | 2001-08-28 | 2006-07-11 | Sbc Properties, L.P. | Method and system to improve the transport of compressed video data in real time |
US7079545B1 (en) * | 2001-12-17 | 2006-07-18 | Applied Microcircuits Corporation ( Amcc) | System and method for simultaneous deficit round robin prioritization |
US7158536B2 (en) * | 2004-01-28 | 2007-01-02 | Rambus Inc. | Adaptive-allocation of I/O bandwidth using a configurable interconnect topology |
US7158528B2 (en) * | 2000-12-15 | 2007-01-02 | Agere Systems Inc. | Scheduler for a packet routing and switching system |
US7180867B2 (en) * | 2000-12-26 | 2007-02-20 | Lucent Technologies Inc. | Apparatus and method for flow path based fault detection and service restoration in a packet based switching system |
US7203202B2 (en) * | 2001-10-31 | 2007-04-10 | Polytechnic University | Arbitration using dual round robin matching with exhaustive service of winning virtual output queue |
US7209453B1 (en) * | 2001-12-14 | 2007-04-24 | Applied Micro Circuits Corporation | System and method for tolerating control link faults in a packet communications switch fabric |
US7221652B1 (en) * | 2001-12-14 | 2007-05-22 | Applied Micro Circuits Corporation | System and method for tolerating data link faults in communications with a switch fabric |
US7227860B2 (en) * | 2000-03-01 | 2007-06-05 | Nec Corporation | Packet switch and method of scheduling the same |
US7236491B2 (en) * | 2000-11-30 | 2007-06-26 | Industrial Technology Research Institute | Method and apparatus for scheduling for packet-switched networks |
US7236488B1 (en) * | 2001-08-10 | 2007-06-26 | Gautam Kavipurapu | Intelligent routing switching system |
US7327725B2 (en) * | 2002-11-27 | 2008-02-05 | Alcatel Canada Inc. | Method and apparatus capable of transferring very high data rates across a midplane or backplane |
US7349403B2 (en) * | 2001-09-19 | 2008-03-25 | Bay Microsystems, Inc. | Differentiated services for a network processor |
US7515537B2 (en) * | 2001-06-13 | 2009-04-07 | Mcdata Services Corporation | Method and apparatus for rendering a cell-based switch useful for frame based protocols |
Family Cites Families (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5168570A (en) * | 1989-12-29 | 1992-12-01 | Supercomputer Systems Limited Partnership | Method and apparatus for a multiple request toggling priority system |
US5185716A (en) * | 1991-07-22 | 1993-02-09 | Mehdipour Frank F | Three dimensional combined magneto-optical memory and logic processor |
DE69428186T2 (en) * | 1994-04-28 | 2002-03-28 | Hewlett Packard Co | Multicast device |
US5815715A (en) * | 1995-06-05 | 1998-09-29 | Motorola, Inc. | Method for designing a product having hardware and software components and product therefor |
EP0748087A1 (en) * | 1995-06-09 | 1996-12-11 | International Business Machines Corporation | Access control system for a shared buffer |
DE69635880T2 (en) | 1995-09-18 | 2006-10-05 | Kabushiki Kaisha Toshiba, Kawasaki | System and method for the transmission of parcels, suitable for a large number of entrance gates |
US5815716A (en) | 1995-10-06 | 1998-09-29 | International Business Machines Corporation | Method for supporting multiple call interface conventions for computer programs using directives |
KR0152228B1 (en) * | 1995-12-23 | 1998-11-02 | 양승택 | Method for transmitting and receiving data by using dispersed routine control in data switching system |
JP2929991B2 (en) | 1996-01-29 | 1999-08-03 | 日本電気株式会社 | Optimization credit control method |
US6636518B1 (en) | 1996-12-16 | 2003-10-21 | Juniper Networks | Synchronizing source-synchronous links in a switching device |
US5991297A (en) * | 1997-08-28 | 1999-11-23 | Ascend Communications | Independently sizable memory pages for a plurality of connection ID types in a network switch |
US6137807A (en) | 1997-12-05 | 2000-10-24 | Whittaker Corporation | Dual bank queue memory and queue control system |
US6487213B1 (en) | 1998-01-05 | 2002-11-26 | Polytechnic University | Methods and apparatus for fairly arbitrating contention for an output port |
WO1999056433A2 (en) | 1998-04-29 | 1999-11-04 | Abrizio, Inc. | Packet-switch system |
US6160812A (en) * | 1998-05-04 | 2000-12-12 | Cabletron Systems, Inc. | Method and apparatus for supplying requests to a scheduler in an input buffered multiport switch |
US6667984B1 (en) | 1998-05-15 | 2003-12-23 | Polytechnic University | Methods and apparatus for arbitrating output port contention in a switch having virtual output queuing |
US20020150056A1 (en) * | 1998-05-15 | 2002-10-17 | Martin Abadi | Method for avoiding broadcast deadlocks in a mesh-connected network |
US6636932B1 (en) * | 1998-05-27 | 2003-10-21 | Micron Technology, Inc. | Crossbar switch and control for data networks switching |
US6654374B1 (en) | 1998-11-10 | 2003-11-25 | Extreme Networks | Method and apparatus to reduce Jitter in packet switched networks |
US6643297B1 (en) | 1998-12-21 | 2003-11-04 | Nortel Networks Limited | Network service provider architecture in communications network |
US7293090B1 (en) * | 1999-01-15 | 2007-11-06 | Cisco Technology, Inc. | Resource management protocol for a configurable network router |
US6661788B2 (en) | 1999-05-14 | 2003-12-09 | Nortel Networks Limited | Multicast scheduling for a network device |
US6791992B1 (en) * | 1999-10-07 | 2004-09-14 | The Regents Of The University Of California | Earliest-deadline-first queuing cell switching architecture and method |
US7102999B1 (en) * | 1999-11-24 | 2006-09-05 | Juniper Networks, Inc. | Switching device |
US6621828B1 (en) * | 1999-12-01 | 2003-09-16 | Cisco Technology, Inc. | Fused switch core and method for a telecommunications node |
US20050214825A1 (en) * | 2000-02-07 | 2005-09-29 | John Stuelpnagel | Multiplex sample analysis on universal arrays |
US7111053B1 (en) * | 2000-05-20 | 2006-09-19 | Ciena Corporation | Template-driven management of telecommunications network via utilization of operations support services clients |
JP3938460B2 (en) * | 2000-05-24 | 2007-06-27 | 株式会社リコー | Information recording apparatus, information recording method, recording medium on which information recording processing program is recorded, optical disc recording apparatus, optical disc recording method, information recording system, and optical disc recording system |
US6816500B1 (en) * | 2000-07-10 | 2004-11-09 | 3Com Corporation | Apparatus, method and system for multimedia access network channel management |
US6804193B1 (en) * | 2000-07-28 | 2004-10-12 | Marconi Intellectual Property (Ringfence) Inc. | Protected Ethernet backplane communication |
US6850997B1 (en) * | 2000-09-27 | 2005-02-01 | International Business Machines Corporation | System, method, and program for determining the availability of paths to a device |
US7133399B1 (en) * | 2000-10-31 | 2006-11-07 | Chiaro Networks Ltd | System and method for router central arbitration |
US6940851B2 (en) | 2000-11-20 | 2005-09-06 | Polytechnic University | Scheduling the dispatch of cells in non-empty virtual output queues of multistage switches using a pipelined arbitration scheme |
US6636515B1 (en) | 2000-11-21 | 2003-10-21 | Transwitch Corporation | Method for switching ATM, TDM, and packet data through a single communications switch |
US7023840B2 (en) * | 2001-02-17 | 2006-04-04 | Alcatel | Multiserver scheduling system and method for a fast switching element |
US20030063839A1 (en) * | 2001-05-11 | 2003-04-03 | Scott Kaminski | Fault isolation of individual switch modules using robust switch architecture |
US7151925B2 (en) * | 2001-09-10 | 2006-12-19 | Industrial Technology Research Institute | Software defined radio (SDR) architecture for wireless digital communication systems |
US7085846B2 (en) * | 2001-12-31 | 2006-08-01 | Maxxan Systems, Incorporated | Buffer to buffer credit flow control for computer network |
US7139995B1 (en) * | 2002-03-19 | 2006-11-21 | Xilinx, Inc. | Integration of a run-time parameterizable core with a static circuit design |
US7415594B2 (en) * | 2002-06-26 | 2008-08-19 | Coherent Logix, Incorporated | Processing system with interspersed stall propagating processors and communication elements |
US20040038385A1 (en) * | 2002-08-26 | 2004-02-26 | Langlois Richard G. | System for autonomous monitoring of bioagents |
US7154902B1 (en) * | 2002-10-21 | 2006-12-26 | Force10 Networks, Inc. | Epoch-based packet switching |
US7283532B2 (en) * | 2002-10-25 | 2007-10-16 | Alcatel Lucent | Hierarchical scheduler architecture for use with an access node |
US7260066B2 (en) * | 2002-10-31 | 2007-08-21 | Conexant Systems, Inc. | Apparatus for link failure detection on high availability Ethernet backplane |
US7381547B2 (en) * | 2004-04-28 | 2008-06-03 | Tzam Diagnostics, Llc | Methods and compositions to detect bacteria using multiplex PCR |
US7412551B2 (en) * | 2004-06-30 | 2008-08-12 | Intel Corporation | Methods and apparatus for supporting programmable burst management schemes on pipelined buses |
-
2003
- 2003-02-24 US US10/373,139 patent/US7352694B1/en active Active
- 2003-03-24 US US10/395,367 patent/US7304987B1/en not_active Expired - Fee Related
- 2003-03-31 US US10/403,964 patent/US7298754B1/en not_active Expired - Fee Related
- 2003-03-31 US US10/403,979 patent/US7298756B1/en not_active Expired - Fee Related
-
2008
- 2008-04-15 US US12/103,683 patent/US20080256455A1/en not_active Abandoned
- 2008-04-17 US US12/105,218 patent/US7965624B2/en not_active Expired - Fee Related
Patent Citations (100)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5197016A (en) * | 1988-01-13 | 1993-03-23 | International Chip Corporation | Integrated silicon-software compiler |
US5422881A (en) * | 1989-06-30 | 1995-06-06 | Inmos Limited | Message encoding |
US5231633A (en) * | 1990-07-11 | 1993-07-27 | Codex Corporation | Method for prioritizing, selectively discarding, and multiplexing differing traffic type fast packets |
US20060013207A1 (en) * | 1991-05-01 | 2006-01-19 | Mcmillen Robert J | Reconfigurable, fault tolerant, multistage interconnect network and protocol |
US5872904A (en) * | 1991-05-01 | 1999-02-16 | Ncr Corporation | Computer system using a master processor to automatically reconfigure faulty switch node that is detected and reported by diagnostic processor without causing communications interruption |
US5291479A (en) * | 1991-07-16 | 1994-03-01 | Digital Technics, Inc. | Modular user programmable telecommunications system with distributed processing |
US5594657A (en) * | 1993-09-27 | 1997-01-14 | Lucent Technologies Inc. | System for synthesizing field programmable gate array implementations from high level circuit descriptions |
US6519540B1 (en) * | 1994-10-04 | 2003-02-11 | Iris Technologies, Inc. | Signal router with cross-point view graphical interface |
US6067286A (en) * | 1995-04-11 | 2000-05-23 | General Datacomm, Inc. | Data network switch with fault tolerance |
US6055599A (en) * | 1995-09-11 | 2000-04-25 | Electronics & Telecommunications Research Institute | Hierarchical crossbar interconnection network for a cluster-based parallel processing computer |
US5610745A (en) * | 1995-10-26 | 1997-03-11 | Hewlett-Packard Co. | Method and apparatus for tracking buffer availability |
US5781745A (en) * | 1996-05-20 | 1998-07-14 | 3Com Corporation | High speed communication bus |
US20020058258A1 (en) * | 1996-06-04 | 2002-05-16 | Wittwer Carl T. | Monitoring hybridization during PCR using SYBR Green I |
US6515991B1 (en) * | 1996-06-27 | 2003-02-04 | Cisco Technology, Inc. | Combined unicast and multicast scheduling |
US6101193A (en) * | 1996-09-10 | 2000-08-08 | Kabushiki Kaisha Toshiba | Packet scheduling scheme for improving short time fairness characteristic in weighted fair queueing |
US5889779A (en) * | 1996-12-02 | 1999-03-30 | Rockwell Science Center | Scheduler utilizing dynamic schedule table |
US7009985B2 (en) * | 1997-01-23 | 2006-03-07 | Broadcom Corporation | Fibre channel arbitrated loop bufferless switch circuitry to increase bandwidth without significant increase in cost |
US5883814A (en) * | 1997-03-13 | 1999-03-16 | International Business Machines Corporation | System-on-chip layout compilation |
US6606588B1 (en) * | 1997-03-14 | 2003-08-12 | Interuniversitair Micro-Elecktronica Centrum (Imec Vzw) | Design apparatus and a method for generating an implementable description of a digital system |
US6275491B1 (en) * | 1997-06-03 | 2001-08-14 | Texas Instruments Incorporated | Programmable architecture fast packet switch |
US6252853B1 (en) * | 1997-07-24 | 2001-06-26 | Hitachi, Ltd. | Switching router and a datagram transfer system |
US20040160970A1 (en) * | 1997-08-22 | 2004-08-19 | Avici Systems, Inc. | Methods and apparatus for event-driven routing |
US6073199A (en) * | 1997-10-06 | 2000-06-06 | Cisco Technology, Inc. | History-based bus arbitration with hidden re-arbitration during wait cycles |
US6876633B2 (en) * | 1997-10-21 | 2005-04-05 | Intel Corporation | Apparatus and method for computer telephone integration in packet switched telephone networks |
US6343081B1 (en) * | 1997-12-30 | 2002-01-29 | International Business Machines Corporation | Method and apparatus for managing contention in a self-routing switching architecture in a port expansion mode |
US6072772A (en) * | 1998-01-12 | 2000-06-06 | Cabletron Systems, Inc. | Method for providing bandwidth and delay guarantees in a crossbar switch with speedup |
US6563837B2 (en) * | 1998-02-10 | 2003-05-13 | Enterasys Networks, Inc. | Method and apparatus for providing work-conserving properties in a non-blocking switch with limited speedup independent of switch size |
US6044061A (en) * | 1998-03-10 | 2000-03-28 | Cabletron Systems, Inc. | Method and apparatus for fair and efficient scheduling of variable-size data packets in an input-buffered multipoint switch |
US6351466B1 (en) * | 1998-05-01 | 2002-02-26 | Hewlett-Packard Company | Switching systems and methods of operation of switching systems |
US6411599B1 (en) * | 1998-05-29 | 2002-06-25 | International Business Machines Corporation | Fault tolerant switching architecture |
US6553026B1 (en) * | 1998-07-09 | 2003-04-22 | Nec Corporation | Communication path switching apparatus, communication path switching method, and computer program product for controlling communication path switching system |
US6345040B1 (en) * | 1998-07-30 | 2002-02-05 | Marconi Communications, Inc. | Scalable scheduled cell switch and method for switching |
US20010010910A1 (en) * | 1998-08-07 | 2001-08-02 | Boston Probes Inc. | Pna probes, probe sets, methods and kits pertaining to the universal detection of bacteria and eucarya |
US6570873B1 (en) * | 1998-11-13 | 2003-05-27 | Nec Corporation | System and method for scheduling reservation of traffic with priority |
US6549943B1 (en) * | 1999-06-16 | 2003-04-15 | Cisco Technology, Inc. | Network management using abstract device descriptions |
US6490690B1 (en) * | 1999-07-22 | 2002-12-03 | International Business Machines Corporation | Method and apparatus for unix system catastrophic recovery aid |
US7072295B1 (en) * | 1999-09-15 | 2006-07-04 | Tellabs Operations, Inc. | Allocating network bandwidth |
US6850490B1 (en) * | 1999-10-06 | 2005-02-01 | Enterasys Networks, Inc. | Hierarchical output-queued packet-buffering system and method |
US20060127942A1 (en) * | 1999-10-08 | 2006-06-15 | Tore Straume | Particle analysis assay for biomolecular quantification |
US6594695B1 (en) * | 1999-12-08 | 2003-07-15 | Covad Communitions Group, Inc. | Network profiling system |
US6721273B1 (en) * | 1999-12-22 | 2004-04-13 | Nortel Networks Limited | Method and apparatus for traffic flow control in data switches |
US7227860B2 (en) * | 2000-03-01 | 2007-06-05 | Nec Corporation | Packet switch and method of scheduling the same |
US6717956B1 (en) * | 2000-03-03 | 2004-04-06 | Luminous Networks, Inc. | Dual-mode virtual network addressing |
US6990063B1 (en) * | 2000-03-07 | 2006-01-24 | Cisco Technology, Inc. | Distributing fault indications and maintaining and using a data structure indicating faults to route traffic in a packet switching system |
US6999457B2 (en) * | 2000-03-29 | 2006-02-14 | Juniper Networks, Inc. | Arbiter circuit and method of carrying out arbitration |
US6882649B1 (en) * | 2000-03-31 | 2005-04-19 | Sun Microsystems, Inc. | Least choice first arbiter |
US7050448B2 (en) * | 2000-04-05 | 2006-05-23 | Xyratex Technology Limited | Data switching arbitration arrangements |
US6870831B2 (en) * | 2000-05-04 | 2005-03-22 | Pmc-Sierra, Inc. | Flexible, self-aligning time and space switch fabrics |
US20020012344A1 (en) * | 2000-06-06 | 2002-01-31 | Johnson Ian David | Switching system |
US6895528B2 (en) * | 2000-08-07 | 2005-05-17 | Computer Network Technology Corporation | Method and apparatus for imparting fault tolerance in a switch or the like |
US6915372B2 (en) * | 2000-08-31 | 2005-07-05 | Tellabs Operations, Inc. | Methods and apparatus for managing traffic through a buffered crossbar switch fabric |
US7023857B1 (en) * | 2000-09-12 | 2006-04-04 | Lucent Technologies Inc. | Method and apparatus of feedback control in a multi-stage switching system |
US20020039351A1 (en) * | 2000-09-29 | 2002-04-04 | Linghsiao Wang | Bandwidth sharing using emulated weighted fair queuing |
US20020039364A1 (en) * | 2000-10-02 | 2002-04-04 | Satoshi Kamiya | Two-dimensional pipelined scheduling technique |
US20020105966A1 (en) * | 2000-11-17 | 2002-08-08 | Ronak Patel | Backplane interface adapter with error control and redundant fabric |
US20020061028A1 (en) * | 2000-11-20 | 2002-05-23 | Polytechnic University | Scheduling the dispatch of cells in multistage switches using a hierarchical arbitration scheme for matching non-empty virtual output queues of a module with outgoing links of the module |
US7236491B2 (en) * | 2000-11-30 | 2007-06-26 | Industrial Technology Research Institute | Method and apparatus for scheduling for packet-switched networks |
US6781992B1 (en) * | 2000-11-30 | 2004-08-24 | Netrake Corporation | Queue engine for reassembling and reordering data packets in a network |
US7158528B2 (en) * | 2000-12-15 | 2007-01-02 | Agere Systems Inc. | Scheduler for a packet routing and switching system |
US7180867B2 (en) * | 2000-12-26 | 2007-02-20 | Lucent Technologies Inc. | Apparatus and method for flow path based fault detection and service restoration in a packet based switching system |
US7042883B2 (en) * | 2001-01-03 | 2006-05-09 | Juniper Networks, Inc. | Pipeline scheduler with fairness and minimum bandwidth guarantee |
US20020118692A1 (en) * | 2001-01-04 | 2002-08-29 | Oberman Stuart F. | Ensuring proper packet ordering in a cut-through and early-forwarding network switch |
US7035212B1 (en) * | 2001-01-25 | 2006-04-25 | Optim Networks | Method and apparatus for end to end forwarding architecture |
US7016350B2 (en) * | 2001-02-03 | 2006-03-21 | Xyratex Technology Limited | Data switch and a method for controlling the data switch |
US7065046B2 (en) * | 2001-04-06 | 2006-06-20 | Lucent Technologies Inc. | Scalable weight-based terabit switch scheduling method |
US20030031193A1 (en) * | 2001-04-06 | 2003-02-13 | Andrews Daniel M. | Scalable weight-based terabit switch scheduling method |
US20030076848A1 (en) * | 2001-04-27 | 2003-04-24 | Anat Bremler-Barr | Weighted fair queuing-based methods and apparatus for protecting against overload conditions on nodes of a distributed network |
US7342929B2 (en) * | 2001-04-27 | 2008-03-11 | Cisco Technology, Inc. | Weighted fair queuing-based methods and apparatus for protecting against overload conditions on nodes of a distributed network |
US7058057B2 (en) * | 2001-05-01 | 2006-06-06 | Integrated Device Technology, Inc. | Network switch port traffic manager having configurable packet and cell servicing |
US7042842B2 (en) * | 2001-06-13 | 2006-05-09 | Computer Network Technology Corporation | Fiber channel switch |
US7515537B2 (en) * | 2001-06-13 | 2009-04-07 | Mcdata Services Corporation | Method and apparatus for rendering a cell-based switch useful for frame based protocols |
US7406041B2 (en) * | 2001-07-31 | 2008-07-29 | Brocade Communications Systems, Inc. | System and method for late-dropping packets in a network switch |
US20030026267A1 (en) * | 2001-07-31 | 2003-02-06 | Oberman Stuart F. | Virtual channels in a network switch |
US20030026206A1 (en) * | 2001-07-31 | 2003-02-06 | Mullendore Rodney N. | System and method for late-dropping packets in a network switch |
US7236488B1 (en) * | 2001-08-10 | 2007-06-26 | Gautam Kavipurapu | Intelligent routing switching system |
US6990072B2 (en) * | 2001-08-14 | 2006-01-24 | Pts Corporation | Method and apparatus for arbitration scheduling with a penalty for a switch fabric |
US20030035427A1 (en) * | 2001-08-14 | 2003-02-20 | Mehdi Alasti | Method and apparatus for arbitration scheduling with a penalty for a switch fabric |
US20030072326A1 (en) * | 2001-08-14 | 2003-04-17 | Mehdi Alasti | Method and apparatus for parallel, weighted arbitration scheduling for a switch fabric |
US7075990B2 (en) * | 2001-08-28 | 2006-07-11 | Sbc Properties, L.P. | Method and system to improve the transport of compressed video data in real time |
US20030043847A1 (en) * | 2001-08-31 | 2003-03-06 | Haddad Semir S. | Apparatus and method for indexing MPEG video data to perform special mode playback in a digital video recorder and indexed signal associated therewith |
US7218635B2 (en) * | 2001-08-31 | 2007-05-15 | Stmicroelectronics, Inc. | Apparatus and method for indexing MPEG video data to perform special mode playback in a digital video recorder and indexed signal associated therewith |
US20030053470A1 (en) * | 2001-09-18 | 2003-03-20 | Divivier Robert J. | Multicast cell buffer for network switch |
US7349403B2 (en) * | 2001-09-19 | 2008-03-25 | Bay Microsystems, Inc. | Differentiated services for a network processor |
US20030058880A1 (en) * | 2001-09-21 | 2003-03-27 | Terago Communications, Inc. | Multi-service queuing method and apparatus that provides exhaustive arbitration, load balancing, and support for rapid port failover |
US6898728B2 (en) * | 2001-09-25 | 2005-05-24 | Sun Microsystems, Inc. | System domain targeted, configurable interconnection |
US6871294B2 (en) * | 2001-09-25 | 2005-03-22 | Sun Microsystems, Inc. | Dynamically reconfigurable interconnection |
US7203202B2 (en) * | 2001-10-31 | 2007-04-10 | Polytechnic University | Arbitration using dual round robin matching with exhaustive service of winning virtual output queue |
US7221652B1 (en) * | 2001-12-14 | 2007-05-22 | Applied Micro Circuits Corporation | System and method for tolerating data link faults in communications with a switch fabric |
US7209453B1 (en) * | 2001-12-14 | 2007-04-24 | Applied Micro Circuits Corporation | System and method for tolerating control link faults in a packet communications switch fabric |
US7079545B1 (en) * | 2001-12-17 | 2006-07-18 | Applied Microcircuits Corporation ( Amcc) | System and method for simultaneous deficit round robin prioritization |
US20030112757A1 (en) * | 2001-12-19 | 2003-06-19 | Thibodeau Mark Jason | System and method for providing gaps between data elements at ingress to a network element |
US7020131B1 (en) * | 2001-12-24 | 2006-03-28 | Applied Micro Circuits Corp. | System and method for hierarchical switching |
US6591286B1 (en) * | 2002-01-18 | 2003-07-08 | Neomagic Corp. | Pipelined carry-lookahead generation for a fast incrementer |
US20040161767A1 (en) * | 2002-06-28 | 2004-08-19 | Baldwin Brett R. | Detection and quantification of aromatic oxygenase genes by real-time PCR |
US20040030766A1 (en) * | 2002-08-12 | 2004-02-12 | Michael Witkowski | Method and apparatus for switch fabric configuration |
US20040047408A1 (en) * | 2002-09-10 | 2004-03-11 | Ingo Koenenkamp | Data link analyzer |
US20040093601A1 (en) * | 2002-11-07 | 2004-05-13 | Quicksilver Technology, Inc. | Method, system and program for developing and scheduling adaptive integrated circuity and corresponding control or configuration information |
US7327725B2 (en) * | 2002-11-27 | 2008-02-05 | Alcatel Canada Inc. | Method and apparatus capable of transferring very high data rates across a midplane or backplane |
US20040153566A1 (en) * | 2003-01-31 | 2004-08-05 | Brocade Communications Systems, Inc. | Dynamic link distance configuration for extended fabric |
US7158536B2 (en) * | 2004-01-28 | 2007-01-02 | Rambus Inc. | Adaptive-allocation of I/O bandwidth using a configurable interconnect topology |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8418129B1 (en) | 2001-12-14 | 2013-04-09 | Qualcomm Incorporated | Method for automatically generating code to define a system of hardware elements |
US20070055794A1 (en) * | 2005-09-07 | 2007-03-08 | Willy Chuang | System and method for modifying firmware of an optical storage medium device without requiring a compiling process |
US7779400B2 (en) * | 2005-09-07 | 2010-08-17 | Via Technologies Inc. | System and method for modifying firmware of an optical storage medium device without requiring a compiling process |
US20110084977A1 (en) * | 2009-10-13 | 2011-04-14 | Duluk Jr Jerome Francis | State shadowing to support a multi-threaded driver environment |
US9401004B2 (en) * | 2009-10-13 | 2016-07-26 | Nvidia Corporation | State shadowing to support a multi-threaded driver environment |
US20120072701A1 (en) * | 2009-10-16 | 2012-03-22 | Duluk Jr Jerome Francis | Method Macro Expander |
US8669991B2 (en) * | 2009-10-16 | 2014-03-11 | Nvidia Corporation | Method macro expander |
US20130191569A1 (en) * | 2012-01-25 | 2013-07-25 | Qualcomm Incorporated | Multi-lane high-speed interfaces for high speed synchronous serial interface (hsi), and related systems and methods |
Also Published As
Publication number | Publication date |
---|---|
US7965624B2 (en) | 2011-06-21 |
US20080253294A1 (en) | 2008-10-16 |
US7304987B1 (en) | 2007-12-04 |
US7298754B1 (en) | 2007-11-20 |
US7352694B1 (en) | 2008-04-01 |
US7298756B1 (en) | 2007-11-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7965624B2 (en) | Data link fault tolerance | |
CN108319563B (en) | Network function acceleration method and system based on FPGA | |
US11003604B2 (en) | Procedures for improving efficiency of an interconnect fabric on a system on chip | |
US7979552B1 (en) | Programmatic instantiation, provisioning, and management of fabric-backplane enterprise servers | |
US8301749B1 (en) | Unused resource recognition in real time provisioning and management of fabric-backplane enterprise servers | |
JP3832816B2 (en) | Network processor, memory configuration and method | |
US7561571B1 (en) | Fabric address and sub-address resolution in fabric-backplane enterprise servers | |
US8601053B2 (en) | Multi-chassis fabric-backplane enterprise servers | |
US7860097B1 (en) | Fabric-backplane enterprise servers with VNICs and VLANs | |
USRE44129E1 (en) | System and method for instruction-level parallelism in a programmable multiple network processor environment | |
US7664110B1 (en) | Input/output controller for coupling the processor-memory complex to the fabric in fabric-backplane interprise servers | |
US8868790B2 (en) | Processor-memory module performance acceleration in fabric-backplane enterprise servers | |
KR100498824B1 (en) | Vlsi network processor and methods | |
US7953903B1 (en) | Real time detection of changed resources for provisioning and management of fabric-backplane enterprise servers | |
KR100481258B1 (en) | Network processor processing complex and mrthods | |
US20100275199A1 (en) | Traffic forwarding for virtual machines | |
US7995472B2 (en) | Flexible network processor scheduler and data flow | |
KR20020024330A (en) | Network switch and components and method of operation | |
JP2003508967A (en) | Network switch using network processor and method | |
US8065454B1 (en) | System and method for mapping functions to and from network devices using configuration compatible with an adapter by remapping plurality of logical ports of adapter | |
US20100057953A1 (en) | Data processing system | |
US20080151880A1 (en) | Data switching using soft configuration | |
US9699118B2 (en) | System for flexible dynamic reassignment of throughput | |
US7702717B2 (en) | Method and apparatus for controlling management agents in a computer system on a packet-switched input/output network | |
US7398501B2 (en) | System and method for optimizing an integrated circuit design |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: QUALCOMM INCORPORATED, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:APPLIED MICRO CIRCUITS CORPORATION;REEL/FRAME:021876/0013 Effective date: 20080715 Owner name: QUALCOMM INCORPORATED,CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:APPLIED MICRO CIRCUITS CORPORATION;REEL/FRAME:021876/0013 Effective date: 20080715 |
|
AS | Assignment |
Owner name: APPLIED MICROCIRCUITS CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RIPA, ALBERTO;BENSCHOP, PETER;CLOVIS, PHILIP;AND OTHERS;REEL/FRAME:022704/0072;SIGNING DATES FROM 20030324 TO 20030325 Owner name: APPLIED MICROCIRCUITS CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RIPA, ALBERTO;BENSCHOP, PETER;CLOVIS, PHILIP;AND OTHERS;SIGNING DATES FROM 20030324 TO 20030325;REEL/FRAME:022704/0072 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |