Network Working Group J. Halpern Request for Comments: 1223 NSC May 1991 OSI CLNS and LLC1 Protocols on Network Systems HYPERchannel Status of this Memo The intent of this document is to provide a complete discussion of the protocols and techniques used to transmit OSI CLNS and LLC1 datagrams (and any associated higher level protocols) on Network Systems Corporation's HYPERchannel equipment. This document is intended for network planners and implementers who are already familiar with the OSI protocol suite and the techniques used to carry OSI traffic on standard networks such as 802.3. This memo provides information for the Internet community. It does not specify an Internet standard. Distribution of this memo is unlimited. Table of Contents Goals of this Document . . . . . . . . . . . . . . . . . . . . . 1 HYPERchannel Network Messages . . . . . . . . . . . . . . . . . . 2 Message Proper Header . . . . . . . . . . . . . . . . . . . . . 3 TO Addresses and Open Driver Architecture . . . . . . . . . . . 8 Broadcasting . . . . . . . . . . . . . . . . . . . . . . . . . . 9 ES-IS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 IS-IS . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 References . . . . . . . . . . . . . . . . . . . . . . . . . . 12 Security Considerations . . . . . . . . . . . . . . . . . . . . 12 Author's Address . . . . . . . . . . . . . . . . . . . . . . . . 12 Goals of this Document In this document, we have three major technical objectives: 1. To standardize the encapsulation of LLC1 packets over HYPERchannel. The format will be used for OSI CLNS and for any other protocols using LLC1 over HYPERchannel. (Note that if one desires to use the LLC1/SNAP combination for TCP/IP, this is the format to use. This represents an alternative to the native mode for TCP/IP over HYPERchannel, allowing for sharing the medium at the LLC1 layer.) Halpern [Page 1] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 2. To describe how multicast protocols such as ES-IS and IS-IS shall operate over HYPERchannel. As a medium, HYPERchannel does not support either broadcast or multicast. Therefore, special techniques are needed to handle these protocols. Note that these techniques do not allow general multicast, although any specific problem may be solved by a generalization of these methods. 3. To make use of a standardized "message type" field in bytes 8 and 9 of the HYPERchannel network message. To permit better interoperability, NSC maintains a "network protocol registry" where any interested party may obtain a unique value in byte 8 (or bytes 8 and 9) for their own public, private, commercial or proprietary protocol. Lists of assigned protocol type numbers and their "owners" would be periodically published by NSC and are available to interested parties. HYPERchannel Network Messages Unlike most datagram delivery systems, the HYPERchannel network message consists of two parts: Message Proper +--------------------+ | | | | | | | 16-64 bytes | | | | | | | +--------------------+ Associated Data +----------------------------------------------------+ | | | | | | | | | | | | | Unlimited length | | | | | | | | | | | | | +----------------------------------------------------+ Halpern [Page 2] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 The first part is a message header that can be up to 64 bytes in length. The first 16 bytes contain information required for the delivery of the entire message, and the remainder can be used by higher level protocols. The second part of the message, the "Associated Data," can be optionally included with the message proper. In most cases (transmission over HYPERchannel-50 trunks) the length of the associated data is literally unlimited. Others (such as HYPERchannel-10 or transmission within a local HYPERchannel-50 A400 adapter) limit the size of the Associated Data to 4K bytes. If the information sent can be contained within the Message Proper, then the Associated Data need not be sent. HYPERchannel lower link protocols treat messages with and without Associated Data quite differently; "Message only" transmissions are sent using abbreviated protocols and can be queued in the receiving network adapter, thus minimizing the elapsed time needed to send and receive the messages. When associated data is provided, the HYPERchannel-50 adapters free their logical resources towards driving the host interface and coaxial trunks at maximum speed, so that data can flow through the transmitting channel, the coaxial cable, and the receiving channel concurrently. Thus HYPERchannel-50 can approach the nominal burst speed of the computer host interface when sending large data blocks over an extended period. Message Proper Header The first 16 bytes of the network Message Proper are examined by the network adapters to control delivery of the network message. The message format is as follows: Halpern [Page 3] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 byte Message Proper +------------------------------------------------------------+ 0 | Trunks to Try | Message Flags | | TO trunks | FROM trunks | |A/D| +--------------+---------------+-------------------------+---+ 2 | TO Domain # | TO Network # | | | | +------------------------------+-----------------------------+ 4 | TO Unit # | Logical To | | | (port number) | +------------------------------+-----------------------------+ 6 | From Unit # | Logical From | | | (port number) | +------------------------------+-----------------------------+ 8 | Message type | | 0x0B01 | +------------------------------+-----------------------------+ 10 | FROM Domain # | FROM Network # | | | | +------------------------------+-----------------------------+ 12 | True Unit | age count | | | | +------------------------------+-----------------------------+ 14 | Header End Offset | Next Header Offset | | (16) | (16) | +------------------------------+-----------------------------+ 16 | LLC1 destination SAP | LLC1 source SAP | | (0xFE for CLNP) | (0xFE for CLNP) | +------------------------------+-----------------------------+ 18 | LLC1 function code | | | (0x03 for normal data) |Start of upper layer protocol| +------------------------------+ + 20 | from bytes 19-63 of the message proper | | and continuing in the associated data | | (For OSI this is CLNP, then transport etc.) | +------------------------------+-----------------------------+ Trunks to Try Consists of two four bit masks indicating which of four possible HYPERchannel-50 coaxial data trunks are to be used to transmit the message and to return it. If a bit in the mask is ON, then the adapter firmware will logically AND it with the mask of installed trunk interfaces and use the result as a candidate list of interfaces. Whenever one of the internal "frames" are sent to communicate with Halpern [Page 4] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 the destination adapter, the transmission hardware electronically selects the first non-busy trunk out of the list of candidates. Thus selection of a data trunk is best performed by the adapter itself rather than by the host. Dedicating trunks to specific applications only makes sense in very critical real time applications such as streaming data directly from high speed overrunable peripherals. A second Trunk mask is provided for the receiving adapter when it sends frames back to the transmitter, as it is possible to build asymmetric configurations of data trunks where trunk 1 on one box is connected to the trunk 3 interface of a second. Such configurations are strongly discouraged, but the addressing structure supports it if needed. The "trunks to try" field is only used by HYPERchannel-50. To assure maximum interoperability, a value of 0xFF should be placed in this field to assure delivery over any technology. The newer DX series units determine the trunk mask on their own, but this field is preserved for use with A series equipment. Message Flags Contains options in message delivery. There are several bits defined by the hardware. However, only the A/D bit will be described here. Other bits are used only for special diagnostic or management purposes. If there is a need to set them, check the specific Network Systems manuals on their meanings. In the absence of such need, all bits other than A/D shall be set to zero on transmission, and not examined upon receipt of a message. ASSOCIATED DATA PRESENT (A/D) is ON if an Associated Data block follows the Message Proper. 0 if only a message proper is present in the network message. The value of this bit is enforced by the network adapter firmware. TO Domain Number This is the most significant byte of the four byte hyperchannel address. It selects an NSC addressing domain, among a set of domains. If this and the network number both refer to the local domain and network, they may be set to 0. TO Network Number This is the destination network number. It identifies the network within the selected domain, where the destination unit resides. If the destination is in the local domain and network, both the TO domain and TO network numbers may be set to zero. Halpern [Page 5] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 TO Unit Upon arrival at the destination domain and network, this is the unit number of the destination HYPERchannel adapter. The combination of Domain, Network, and Unit uniquely identify a single adapter in a HYPERchannel network. For compatibility with existing HYPERchannel equipment, when sending a message to a destination outside the local domain and network, set this byte to 0, and store the actual destination unit number in the True Unit field. Logical To This field further identifies which process the message is intended for. With some hardware, the bottom bits select a machine from among several. When sending a message to an N400, the bottom two bits of this field select which of four attached hosts the message is destined for. Within a host, the logical to field selects a destination process. This is used in conjunction with the Message Type field to insure that messages are delivered to the correct place. The Logical TO field identifies a process, which then checks the Message Type to insure that it understands the message. This also allows for running two processes, both of which understand the same protocol. From Unit This identifies the Unit number from which this message was sent. Logical From This identifies the host and process who originated this message. Message Type The following two bytes are reserved for NSC. Users have been encouraged to put a zero in byte 8 and anything at all in byte 9 so as to not conflict with internal processing of messages by NSC firmware. In the past, this field has been loosely defined as carrying information of interest to NSC equipment carrying the message and not as a formal protocol type field. For example, an 0xFF00 in bytes 8 and 9 of the message will cause the receiving adapter to loop back the message without delivering it to the attached host. NSC now uses both bytes 8 and 9 as a formal "protocol type" designator. Major protocols will be assigned a unique value in byte 8 that will (among good citizens) not duplicate a value generated by a different protocol. Minor protocols will have 16 bit values Halpern [Page 6] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 assigned to them so that we won't run out when 256 protocols turn up. Any interested party could obtain a protocol number or numbers by application to NSC. In this document, protocol types specific to OSI LLC1 are assigned. Specifically, the sixteen bit value 0x0B01 in bytes 8 and 9 shall identify LLC1 packets. True Unit This field is used to handle addressing outside of the local domain and network. For compatibility with previous NSC hardware, one may not put the destination unit number in the TO Unit field if the destination domain or network are not the local ones. In that case, one puts zero in the TO Unit field, and puts the destination Unit number into the TRUE unit field. NSC Link devices will adjust the message when it arrives at the destination domain and network so that the destination unit number appears in the TO Unit field. Age Count This field serves as a "time to live" in that it prevents datagrams from endlessly circulating about in an improperly configured network. Each time a message with this format passes through a bridge, the Age Count is decremented by one. When the result is zero, the message is discarded by the bridge. Therefore, this byte should be set to 255 when a message is originated, and ignored when a message is received. Next Header Offset and Header End Offset These fields are used by the hardware to determine if any special addressing is present. No special addressing forms are permitted in conjunction with LLC1. Therefore, these fields shall always be set to 16. Receivers may count on the LLC1 information beginning at offset 16 in the message proper. LLC1 Data The LLC1 Information begins at byte 16 of the message, for 3 bytes. The contains the LLC1 destination and source SAPs, followed by the LLC1 type identifier (usually 03 for unnumbered information.) Higher Layer Protocol Data Higher layer protocol information follows immediately after the LLC1 header in the message proper, and flows into the associated data. For purposes of this document, this is OSI CLNP, but it may be any protocol which uses LLC1. Halpern [Page 7] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 TO Addresses and Open Driver Architecture Since not all 16 bits of the TO address are used for the physical delivery of the network message, the remainder are considered "logical" in that their meaning is physically determined by host computer software or (in cases such as the FIPS data channel) by hardware in the host interface. Since HYPERchannel is and will be used to support a large variety of general and special purpose protocols, it is desirable that several independent protocol servers be able to independently share the HYPERchannel network interface. The implementation of many of NSC's device drivers as well as those of other parties (such as Cray Research) support this service. Each protocol server that wishes to send or receive HYPERchannel network messages logically connects to a HYPERchannel device driver by specifying the complete 16 bit TO address it will own in the sense that any network message with that TO address will be delivered to that protocol server. The logical TO field serves a function similar to the TYPE byte in the Ethernet message header, but differs from it in that the width of the logical TO field varies from host to host, and that no values of the logical TO address are reserved for particular protocols. On the other hand, it is possible to have several "identical" protocols (such as two independent copies of OSI with different HYPERchannel addresses) sharing the same physical HYPERchannel interface. This makes NSC's addressing approach identical to the OSI concept that the protocol server to reach is embedded within the address, rather than the IP notion of addressing a "host" and identifying a server through a message type. Since the HYPERchannel header also has a "message type" field, there is some ambiguity concerning the respective roles of the message type and logical TO fields: o The logical TO field is always used to identify the protocol server which will receive the message. Once a server has specified the complete TO address for the messages it wishes to receive, the message will not be delivered to a different protocol server regardless of the contents of the message type field. o Although the type field cannot change the protocol server at the final destination of the message, the type field can be used by intermediate processes on the network to process the message before it reaches the server destination. An obvious example is the 0xFF00 message loopback type function, where network processing to loop back the message results in nondelivery to the TO address. In the future, intermediate nodes may process Halpern [Page 8] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 in transit messages based on the message type only for purposes such as security validation, aging of certain datagrams, and network management. Broadcasting NSC message forwarding protocols use low level link protocols to negotiate transmission of a message to its next destination on the network. Furthermore, NSC network boxes often fan out so that several hosts share the same network transmission equipment as in the A400 adapter. Both these characteristics mean that providing a genuine broadcast capability is not a trivial task, and in fact no NSC technology supports a broadcast capability. However, the OSI ES-IS and IS-IS protocols require a broadcast capability to operate. Therefore, in order to support these protocols, some form of broadcast emulation must be used. ES-IS The End System to Intermediate System routing protocol is used by end systems to decide where to send packets. In the specified protocol, multicast messages are used so that end systems learn about intermediate systems, and intermediate systems learn about end systems. End systems normally then transmit any packets, whose correct mac destination is unknown, to a random intermediate system which then forwards the packet and tells the originator where to send future packets. There are two situations which are distinct but related for support of this protocol over HYPERchannel. These are distinguished by whether or not there are any real intermediate systems on the HYPERchannel network. ES-IS with Intermediate Systems If there are one or more intermediate systems on the HYPERchannel, then the behavior is simply to emulate multicast. END SYSTEM SUPPORT Each end system is profiled with a list of intermediate systems on the HYPERchannel. It is desirable but not necessary that this list be complete, as the future support for IS-IS will forward the necessary information to all the intermediate systems. Given the profiled list, whenever the end system wishes to originate an ESH packet (End System Hello), it will send individual copies to each intermediate system it knows about. Halpern [Page 9] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 On most systems, these individual packets should be spaced out in time so as not to interfere with the normal transmission of OSI and other HYPERchannel messages. For end systems, an inter-packet time of 0.1 seconds is probably appropriate. Note that if the End System receives ISH packets (Intermediate System Hello) from an IS on HYPERchannel not in its static list, it should add that to the list of systems it will send ESH packets to. The address of the new intermediate system should be remembered for the holding time in the ISH, just as with the normal operation of ES-IS. INTERMEDIATE SYSTEMS Intermediate systems on the HYPERchannel shall also be profiled with the addresses of all the other intermediate systems on the HYPERchannel. This list is used here and in the IS-IS protocol. For the IS-IS protocol operation, it is important that the list be complete. The list of intermediate systems is used, with ES-IS, by an intermediate system only in that it probably is also an end system. As such, it must send ESH packets to all the other intermediate systems. (The presumption that an IS is also an ES is driven by the long term requirements for network management. If you have an upper layer stack, such as is required for CMIP, you are an end system.) Each intermediate system will keep a list of the end systems it knows about. These are the systems it has received ESH packets from. Whenever the IS sends ISH packets, it sends them individually to each ES it has heard from. In addition, it sends the ISH to any end systems which it believes, on the basis of IS- IS or other methods, are on the HYPERchannel. Note that these packets must also be spread out in time to avoid causing congestion. However, given that the number of these is much higher than the number generated by End Systems, the time between transmissions should be selected by the IS developer to fit the sustainable I/O rates of the system. Make sure you can get at the very least one, and preferably two or three, useful packets in between each ISH copy being sent. ES-IS without an Intermediate System When there is no intermediate system, one or more systems must serve as address managers. These are referred to in draft ISO OSI documents as SNARE, for SubNetwork Address Resolution Entities. END SYSTEM SUPPORT As in the previous case, each end system must Halpern [Page 10] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 be profiled with a list of intermediate systems. This list must contain all of the systems which will be serving as address managers on this network. The reason for this is that, since the address managers are not true intermediate systems, they are not running IS-IS and will not be exchanging lists of end systems they know about. There may well be several systems for redundancy and reliability. SNARE The systems selected as address managers must appear, to the other end systems, as intermediate systems. This means that each one must send out ISH packets to all the end systems which it hears from. Each of these systems must record all the information from the ESH packets they receive. When a packet for an End System is received at a SNARE, it must behave as an IS. Specifically, it must forward the packet to the correct destination end system, and send a redirect message back to the originator, informing the originator of the correct SNPA (HYPERchannel address) for the end system. Note that these systems are certainly end systems as well, and must send ESH packets to all the intermediate systems on the IS list, which must be complete. ES-IS FORMAT SPECIFICATION All ES-IS PDUS shall be formatted as specified in ISO 9542. They are then sent using LLC1 and the encapsulation specified earlier in this document for transmitting LLC1 over HYPERchannel. RD PDUS When generating Redirect pdus, which contain HYPERchannel SNPAs (addresses), the SNPA shall be represented in four bytes. This shall be used even on a small HYPERchannel network containing only one domain and one network number. QC FUNCTION There is no support for the ES-IS query configuration capability when using HYPERchannel. All systems must have at least one configured intermediate system, which shall be either a true IS or a SNARE. IS-IS The proposed IS-IS protocol for OSI (DP 10589) when run on a LAN requires broadcast capability. Because of the nature of the process for nominating the designated IS on a LAN, and other special features of this protocol, it is important never to partition the set of intermediate systems on a HYPERchannel network. The implementation therefore is very simple. An intermediate system Halpern [Page 11] RFC 1223 OSI and LLC1 on HYPERchannel May 1991 on HYPERchannel runs the IS-IS protocol directly. However, when it goes to send a message, it consults the profiled list of all level 1 ISs on the HYPERchannel or of all level 2 ISs on the HYPERchannel, and then sends individual copies of the message to each destination. This multiple transmission should be transparent to the IS-IS protocol itself. Note that as with ES-IS on an intermediate system, it is important to space out the individual message transmissions. On most networks, spacing of 0.1 seconds will work well. References +1+ ISO IS 9542 - End system to intermediate system routing exchange protocol +2+ ISO DP 10589 - Intermediate system to Intermediate system Infra-Domain routing exchange protocol Security Considerations Security issues are not discussed in this memo. Author's Address Joel M. Halpern Principal Engineer Network Systems Corporation MS033 7600 Boone Avenue North Brooklyn Park, AN 55428 Phone: (612) 424-1606 Email: jmh@anubis.network.com Halpern [Page 12]