Preprint
Article
Approximate Priority Hybrid 3DNoC Buffered-Bufferless Router
Altmetrics
Downloads
110
Views
51
Comments
0
A peer-reviewed article of this preprint also exists.
This version is not peer-reviewed
Submitted:
31 December 2022
Posted:
04 January 2023
You are already at the latest version
Alerts
Abstract
This paper introduces a novel 3D NoC router that combines buffered and bufferless routing with approximate priority comparison when deflecting flits. Our proposal is a modification of an asymmetrical router that is buffered in the z dimension ports and bufferless in the x and y dimension ports. Flits that request output ports in the x and y dimensions are granted or deflected based on approximate, instead of accurate, priority comparison. Experimental results show that the proposed router, besides effectively combining the advantages of both buffered and bufferless routers, it achieves additional performance and area gains due to the reduced logic required for approximate priority comparison in flit deflections. Experimental results using synthetic and realistic traffic show that the proposed router begins to saturate at a sifnificantly higher injection rate than a bufferless router, but at a slightly lower injection rate than when using accurate priority comparison. Furthermore, the proposed router achieves higher clock frequencies and reduced area compared to the simpler permutation network.
Keywords:
Subject: Engineering - Electrical and Electronic Engineering
1. Introduction
As power and heat density limited the growth of clock frequencies compared to the prediction of Moore’s law, the dominant design paradigm for processors became the multicore architecture. At the same time, this exchanged the power density problem with the core communication challenge. Networks-on-Chip was proposed as a scalable solution providing the communication bandwidth required by multi and many-core architectures with acceptable area and power consumption [1]. The advance of 3D integration provided an additional incentive, since 3D integration combined with NoCs lead to the emergence of 3D NoC architectures [1]. A key element in the NoC is the router which is responsible for forwarding packets through the network, since it has strict requirements for performance and reliability in the aggressive scaling of CMOS technology [2].
Original NoC routers were on-chip implementations of interconnection network routers with little regard for the unique conditions and stringent requirements imposed by the on-chip environment [1]. The block diagram of such a router is shown in Figure 1. Typical router parameters that depend on network conditions and influence performance, area and power consumption, are flit size, flits per buffer and number of virtual channels. A routing table or a simple logic-based routing technique is used for routing calculation. Typically, each input port has its own private buffers with a number of Virtual Channels (VCs) used to prevent deadlock. The number of input and output ports depends on the topology. A common instance of the router of Figure 1 is a 5-port version for 2D mesh and torus topologies.
Later works took into account the distinctive features of the on-chip environment driven by Moore’s law which led to efforts to optimize the buffers in the router, since they were identified as the power and performance bottleneck. On the other hand, unlike the off-chip environment, wide flits are easy to implement on-chip, leading to higher parallelization.
When buffering is insufficient, NoCs can incorporate hot-potato routing or deflection routing: deflecting flits when buffered slots are unavailable. An extension of that was the even more radical suggestion of completely bufferless routing, in other words forwarding flits to either the desired port or deflecting them, but never storing them locally in the router. This approach trades off routing efficiency (since some flits follow non-minimal paths due to deflections) for router area and power consumption due to the elimination of buffers. The later development of 3D integration, led to adapting the routers proposed originally for 2D NoCs to 3D topologies.
2. Background and Related Work
In this section, we briefly discuss the evolution of NoC routers in terms of buffer organization and the emergence of bufferless routing as a viable router architecture as well as the challenges imposed on router design by 3D integration.
2.1. Background
Buffering is a key component of router design due to its impact on router power consumption and area. Various approaches to buffer organization have been proposed. which can be classified as belonging to one of the following strategies [1]:
- Static approaches [4,5]: In this approach the buffer sizes are static. Either all routers are identical in buffer size, or the optimal buffer organization is determined at design time through design space exploration usually for a specific application(s).
- Run-time buffer allocation of a shared centralized buffer [6–10]: Typically a centralized or shared buffer is allocated dynamically to VCs according to real-time traffic requirements. This approach provides adaptivity, unlike the previous one.
- Buffer bypassing [11]: This approach recognizes that buffers often become a performance bottleneck and seeks to bypass router buffers as much as possible.
- Deflection routing [12,13]: These approaches seek to reduce buffer size or eliminate buffers completely by misrouting (deflecting) incoming packets.
The last approach was introduced in [12], making the claim that completely bufferless routing demonstrates significant power gains compared to buffered routing, at a reasonable trade-off of some performance, that would be negligible at low injection rates. However, buffered router networks outperform buffeless ones at high injection rates as they exhibit higher network saturation points than buffered ones. One way to define network saturation point is the following:
Definition 1.
The injection rate for which the network latency is double the zero-load latency of the same network is the saturation injection rate or saturation threshold of the network.
Definition 2.
The value of network latency equal to double the zero load latency is the saturation latency.
Unlike buffered NoCs, saturation in bufferless NoCs is due to large number of flit deflections not overrun buffers. 3D integration imposes additional challenges to NoC design, since packets must now travel also in the third dimension. This has led to the extension of both buffered and bufferless routers to the third dimension by adding two additional ports.
2.2. Related Work
The introduction of 3D NoC topologies added the requirement for supporting the 3rd dimension efficiently to existing router designs. Extending the common 2D 5-port router used in 2D mesh and torus topologies to seven ports by adding two additional ports was the reasonable approach [1]. However, this extension is costly in terms of chip area because the crossbar area scales quadratically with the number of ports [1]. Therefore, the 3D mesh router 7x7 crossbar occupies approximately double the area of the 2D mesh router 5x5 crossbar.
The above holds for both buffered and bufferless crossbar-based routers such as 3DBASE (Figure 2). Additionally, in order to avoid deadlock, the baseline bufferless router sorted incoming flits by priority, so that the flit with the highest priority is always assigned its preferred port. The usual priority metric is the packet age. This ensures freedom from livelock since packets that have been in the network for long, will have priority over “younger” packets. It also requires the packet age field to be updated (incremented) by every router in the routing path.
In order to overcome the limitations of the crossbar, a single-cycle 3D bufferless router called 3DPERM with a 3-stage permutation network that permutes packets based on packet age was introduced in [16]. The 3-stage permutation network of 3DPERM is composed of nine permuter blocks as shown in Figure 3. 3DPERM requires less area compared to 3DBASE, but features a lower saturation point due to the elimination of the load computation and priority sort, as well as higher end-to-end latency in cycles, particularly after crossing the saturation point. However, 3DPERM features lower end-to-end latency in nanoseconds at the low injection rates, due to the shorter critical path and therefore features a higher operating frequency [16]. Essentially, the permutation network approach trades-off some routing efficiency and lower saturation point for higher performance below the saturation point. Note that a permutation network-based 3D router uses nine permutation blocks instead of four for a 2D one, requiring again more than double the area.
We implemented 3DPERM in Nangate 45nm technology and analyzed its area and critical path as shown in Tables 1 and 2.
Table 1.
Bufferless router area breakdown.
| Sub-module | Area (%) |
|---|---|
| Permutation network | 57.5% |
| Ejection/injection stage | 35.6% |
| Golden counter | N/A |
| Header updater | 2.7% |
| Other | 4.2% |
Table 2.
Bufferless router critical path breakdown.
| Sub-module | Delay (%) of critical path |
|---|---|
| Permutation network | 71% |
| Ejection/injection stage | 9.1% |
| Header updater | 7.5% |
| Port request logic/Other | 12.38% |
In our previous work [17], an asymmetrical buffered-bufferless hybrid router for 3D NoC architectures called 3DBUFFBLESS (Figure 4) was proposed. The router was evaluated through simulation in terms of latency in cycles and number of hops and through hardware implementation, namely ASIC synthesis results in a 45nm technology in order to demonstrate that the router is a viable alternative to fully buffered and completely bufferless routers. Comparisons with 3DBASE and 3DPERM bufferless routers showed that 3DBUFFBLESS improves the network saturation point and achieves significantly higher performance at modest area and power costs.
In [18], we presented a different approach for improving a permutation network-based bufferless router: permuting and ejecting flits based on the approximate instead of accurate comparison of the priority metric (packet age). By comparing only a subset of the bits in the packet age, flits were classified as old, medium age and young, giving priority to one age class over another while selecting pseudo-randomly between two packets in the same age class. Experimental results showed that this approach, while simplifying the calculation of packet priority, still ensures that older packets have priority over younger ones. The simplified permutation logic led to higher operating frequency and reduced area at the cost of slightly reduced routing efficiency, since more packets are misrouted.
3. Proposed Hybrid Approximate Priority Router Design
The above innovations are essentially orthogonal, a fact that naturally leads to combining the two into a single router, exploiting the advantages of both. The proposed router, named 3DHYAP for 3D Hybrid Approximate Priority Router, is based on the design of Figure 4, augmented with the approximate priority comparison of [18]. The proposed router combines the low cost of bufferless routing, augmented with approximate priority comparison, with the increased routing efficiency of partially buffered routing. In order to minimize hops on the vertical links (TSVs), the proposed router, like 3DBUFFBLESS, features buffering in the up and down ports and no buffering in the ports lying on the same plane. This allows a flit to quickly traverse the chip layers without being deflected, while minimizing the router buffering to only two of the total seven ports. Since a packet may traverse the z dimension of the network similarly to wormhole routing, but may have its flits deflected to different directions when moving in the xy plane, bufferless routing mechanisms such as livelock prevention and flit reordering are still required. However, with no horizontal buffer connections, deadlock is not an issue in a network composed of 3DHYAP routers, because buffered cyclic paths cannot be formed. Therefore, virtual channels are not required, simplifying the design of 3DHYAP.
The bufferless part of the router is based on a two-stage permutation network as shown in Figure 4, but the selector and permutation blocks use approximate priority comparison.
3.1. Quantitative Analysis
The proposed design can be analyzed quantitatively using simple, back-of-the-envelope calculations and the experimental results of Tables 1 and 2. When it comes to performance we expect the permutation network delay to be reduced by one third because it will have two stages instead of three. Since the contribution of the permutation network to the critical path is 71% in 3DPERM we expect according to Ahmdal’s law an improvement of:
In other words we expect a reduction in delay and an improvement in clock frequency by 23.66% by the reduction in permutation stages. We expect an additional improvement by reducing the complexity of each permutation block by using approximate priority comparison.
In terms of area the area gains obtained by having four instead of nine permutation blocks will be partly offset by the increased size of the injection/ejection stage which now will have approximately three times the area of the original. Therefore:
Therefore we expect an area reduction of approximately 20%. We should have additional area gains from the approximate priority comparison that will be partly offset by the addition of buffers. Clearly the final area gains will depend on buffer size, and we explore this in the hardware evaluation section.
Integrating a buffered and a bufferless router in a seamless way proved challenging in the case of 3DBUFBLESS and adding approximate priority comparison requires additional appropriate modifications made to the buffered and bufferless baseline router design as discussed below.
3.2. General Considerations
Similar to 3DBUFBLESS, 3DHYAP features two additional injection and ejection ports on the router datapath in addition to the local port. Essentially the up and down ports (buffered ports) are similar to the local port. Therefore, the ejection/injection stage is modified to contain three ports instead of one. Consequently, up to three additional flits may be injected into the bufferless part of the router at the same time (from the U_in, D_in and L_in ports. For that purpose there are three stall signals, one for each port. This indicates the following possible conditions:
- No deflection output ports are available: This condition happens when there are already four incoming flits from the bufferless input ports and neither is to be ejected. Then, since all incoming flits from bufferless ports must be assigned an output port, no buffered flits can be injected until the next clock cycle.
- There is one available deflection output port: this happens when there are three requests from incoming flits arriving from bufferless ports that are not ejected. In this case, we make the following distinctions: If one of the ports requesting injection is the local port then it is granted and the other(s) port (up or down) is/are stalled. This is meant to ensure that flits are injected to the network as soon as possible. If the only ports requesting injection are the up and down ports, we decide between the two flits based on their age.
- There are two available deflection output ports: in other words, there are two requests from incoming flits that are not ejected. In this case, up to two flits can be injected. In the case of all three injection ports making a request, the one flit granted is the local port’s and the other one is selected from the other two based on age.
- There are two or more flits to be ejected, with at least one from a bufferless input port: In this case, a flit from a bufferless port is selected for ejection, so as not to be deflected. If there is more than one, the oldest is selected.
- There are two flits to be ejected, both from the buffered ports: One flit is selected according to age, the other remains buffered until the next cycle.
3.3. Priority Classes and Rules
The above considerations are formalized in the following ejection/injection rules, which resolve priority of the various types of incoming flits for ejection and injection. The first six apply also to 3DBUFFBLESS, with the last two added because of the approximate priority comarison:
If two or more flits incoming from the bufferless ports request ejection to a local, up or down port, the flit with the highest priority wins, while the rest are injected into the permutation network.
- If an incoming flit from a bufferless input port competes for an ejection port with an incoming flit from a buffered input port, it is ejected while the other remains buffered, and waits for the next cycle.
- If two incoming flits from buffered ports compete for an ejection port, one is selected according to rules 7 and 8, the other remains buffered.
- Incoming flits from bufferless ports win over flits trying to inject from the local and up/down ports, which remain buffered.
- If two or more injection ports are competing, then the local port wins over the up/down ports.
- If the up and down ports are competing for injection, then rules 7 and 8 apply.
- A flit in an “older” age class has priority over a younger flit.
- Two flits belonging to the same age class are permuted in a permutation block, or one is selected in a selector block pseudorandomly.
Therefore, we distinguish between two priority classes: Priority of an input port over another input port and of a flit over another flit.
The priority of ports is resolved first and if it is equal, then the priority of the individual flits is taken into account. We distinguish between three classes of ports: Bufferless input ports (N, S, E, W), buffered input ports (U, D) and the local port (L). For injection, the set of input ports competing are (L, U, D) while for ejection the set of ports competing are (N, S, E, W, U, D). Then the priority of the port classes is as follows:
Priority between flits is resolved using the following rules:
Ejection: Bufferless ports have higher priority than buffered ones:
Injection: The local port has higher priority than the up and down ports:
The rationale behind the ejection priority rule is to prevent flits from bufferless ports from being deflected when reaching their destination or wish to change layer, while flits from buffered ports can simply wait for the next cycle.
The ejection rule enforces “hot-potato” routing for flits that cannot be buffered, while the injection rule ensures that flits are quickly injected to the network and not “trapped” at the source for long. Since there are equal bufferless input and output ports, incoming flits from bufferless ports cannot be dropped. The only case when flits may be dropped is in the case of buffer overrun in the buffered ports.
3.4. Buffered Port Design
The injection/ejection stage is shown in Figure 5. There are two similar ejection ports for the up and down directions which have the local port as input. This incurs no significant performance penalty since the three ejection paths operate in parallel.
3.5. Injection/Ejection Stage
The ejection stage selects at most one flit to be assigned to each of the ejection ports, U_out (up direction), D_out (down direction), and L_out (local port) based on priority while forwarding the remaining flits to the injection stage. As shown in Figure 5 the ejection stage is composed of three trees of flit selector blocks. Each selector accepts two flits as inputs and outputs the one with the highest priority as shown in Figure 6. This way, the flit with the highest priority that has reached its destination is selected for ejection to the L_out port, while the flit with the highest priority that wishes to exit to the upper layer is forwarded to U_out and likewise to the D_out for the lower layer. The remaining flits are either forwarded to the injection stage or remain buffered.
3.6. Approximate Priority Permutation Network
A permutation block is similar to a selector block but requires two multiplexers instead of one for since it permutes two flits as shown in Figure 7. If the incoming flits are requesting different outputs they can both be granted their request. However, when they both request the same output, either U_out or D_out, the one with the highest age field value wins, and the other is deflected to the other permuter output.
3DHYAP adopts the approximate comparison logic of 3DAPBLESS [18], where the magnitude comparator is replaced with simpler logic that compares a subset of the bits in the age field of the competing flits. By comparing only the most significant bits, 3DHYAP essentially separates the flits as belonging to crisp “age classes”.
When competing flits belong to the same age class, they are permuted pseudorandomly. We use a single 16-bit PSRNG, with one bit feeding each of the permutation and ejection blocks. We demonstrate two apprximations as shown in Table 3: using the two most significant bits, and using only a single most significant bit. Using two bits separates flit ages into four classes, while using only one, into two. Essentially a flit with an MSB of 1 in the age field is classified as “old” while a flit with an MSB of 0 is classified as young.
In our evaluation section we consider a 4x4x3 mesh NoC. In this case, the maximum internode distance is 8 hops. Since a reasonable age field would include at least double that number, we use five bits in our design (Figure 8(a)). Similarly to [18], we have expeimented with two versions of 3DHYAP one using the two most significant bits of the age field and one using only one which we term 3DHYAP_lite.
Table 3.
3DHYAP priority classes.
| Priority Class | 2-bit priority field | 1-bit priority field |
|---|---|---|
| young | 00 | 0 |
| fairly young | 01 | |
| fairly old | 10 | |
| old | 11 | 1 |
We next attempt to estimate the additional performance improvement achieved by the approximate priority comparison. In Figure 8(a) is shown the magnitude comparator for a 5-bit age field (inverters not shown). As it can be seen after breaking down the logic to at most 4-input logic gates, four levels of logic are required. In Figure 8 (b) the equivalent circuit with a two-bit priority field is shown, which requires only two logic levels for each magnitude comparator (again inverters are not shown). The proposed approximate priority magnitude comparator now requires both the greater than and equal outputs to decide whether to route the packet deterministically or pseudorandomly, however, these operate in parallel. Finally in Figure 8(c) the equivalent logic using only a single bit for classifying packet age is shown leading to a single level of logic.
The above can be used together with the circuit diagram of Figure 7 to estimate the improvement in the critical path timing. The request logic of the permutation block requires two logic levels, the grant logic requires two logic levels since it is a three-bit boolean function as shown from the table of Figure 7, and the two-to-one multiplexer requires two more levels of logic. Therefore, the original permutation block requires a total of 8 logic levels and the 2-bit priority field permutation block requires six. The one-bit priority field is expected to also require six logic levels since the delay will be dominated by the request logic which still requires two logic levels and operates in parallel with the magnitude comparator. However, it should provide additional area if not performance gains.
We also expect a reduction in the delay of the selector blocks used in the ejection/injection stage, this time from 5 logic levels in the original one, to three and two for the 2-bit and 1-bit priority fields, respectively. Since, according to Table 2 the ejection/injection stage accounts for 9.1% of the critical path delay, we can estimate the performance gains by modifying equation (1) to take this additional analysis into account:
In other words we expect an additional improvement of 15% from the reduced complexity of each permutation block for a 2-bit priority field. Similarly for a 1-bit priority field:
4. Experimental Results—High Level Simulation
For presentation purposes, we divide the evaluation section into the high-level simulation results and the hardware implementation results. The high-level simulations explore the latency in hops under various traffic conditions, while abstracting away irrelevant hardware details, while hardware implementation is used to obtain clock frequency and area figures. We then present combined evaluation results that calculate the latency in nanoseconds using a combination of the latency in cycles obtained by high-level simulation and clock frequency obtained respectively from hardware implementation. For a fair comparison, all routers were designed as single-cycle (no pipelining).
4.1. High-Level Simulation Setup
Regarding high-level simulation, we developed cycle-accurate models of 3DBASE, 3DBUFFBLESS, 3DPERM and 3DHYAP were in the HNoCs environment [19]. The simulation was performed on a 4 × 4 × 3 NoC mesh. The simulation duration was 4 milliseconds with a warm-up period of 4 microseconds. Synthetic and realistic NoC traffic patterns implemented to evaluate the performance of the proposed router. On the side of synthetic traffic patterns we used uniform random traffic, transpose traffic and hotspot traffic starting with an injection rate of 0.04 flits/cycle/node and stopping at the network saturation point. In uniform random traffic, each source sends to all destinations with equal probability. In hotspot traffic source sends to one of the central routers with a probability of 10% and with equal probability to the rest. Finally in transpose traffic source router with coordinates (x, y, z) sends to destination with coordinates (N_x-1-x, N_y-1-y, N_z-1-z), where N_x, N_y, N_z, are the 3D mesh network dimensions.
4.2. Simulation Using Synthetic Traffic
Figure 9 illustrates the average end-to-end latency per flit in cycles under Uniform Random Traffic (URF). Specifically, Figure 9(a) compares 3DBASE, 3DPERM, 3DBUFFBLESS, 3DAPBLESS and 3DHYAP for uniform random traffic. For further clarification we show the zero-load and saturation latency as defined above. For injection rates less than 0.2 flits per cycle per node all routers are close to the zero-load latency. It can be seen that the most vulnerable router to saturation is 3DAPBLESS closely followed by 3DPERM, which begin to saturate at an injection rate of 0.2 flits/cycle/node. These are the bufferless routers using nine permutation blocks, and since 3DAPBLESS misroutes flits more than 3DPERM at high injection rates due to the approximate priority comparison, this result is to be expected.
The next router to begin saturating is 3DBASE at 0.24 flits per cycle per node. This router has very low latency in cycles in the low injection rates since it sorts flits centrally and, therefore, features the fewest deflections among bufferless routers. However, its latency starts rising rapidly after the 0.2 injection point.
3DBUFFBLESS features the lowest saturation overall since it can store some packets instead of deflecting them, but has a slightly higher zero-load latency. 3DHYAP provides a middle ground between 3DBASE and 3DBUFFBLESS, since it stores some flits like 3DBUFFBLESS, but deflects the remaining flits less efficiently than 3DBASE.
Furthermore, it can be observed that 3DHYAP and 3DBUFFBLESS feature somewhat higher end-to-end latency below 0.2 flits per cycle per node and significantly lower above. The reason for the higher end-to-end latency in the low injection rates compared to 3DBASE is that some flits spend time stored in the 3DBUFFBLESS buffers, while in 3DBASE they are always transmitted in the same cycle. Since the injection rate is low, the deflections are few and that incurs some latency overhead. However, at an injection rate of 0.2 the two routers feature virtually the same latency and at the higher injection rates, this trend is reversed emphatically with 3DBUFFBLESS featuring significantly lower latency in cycles. This is due to the fact that 3DBASE deflects many flits, while 3DBUFFBLESS can store incoming flits from the up and down ports until a port becomes available, leading to fewer deflections, and thus fewer hops that offset this additional intra-router latency.
3DHYAP and 3DBUFBLESS reaches saturation latency at the injection rate of 0.24 hops/flit/node while the latency in cycles of 3DBASE at the same injection rate is 30% less than that value. 3DBUFBLESS reaches saturation latency at the injection rate of 0.24 hops/flit/node while the latency in cycles of 3DBASE at the same injection rate is 30% less than that value. Furthermore, as will be discussed in the hardware evaluation results, due to the higher clock frequencies achieved by 3DBUFFBLESS the gains in latency in ns is approximately 50% of that value.
Figure 9 (b) separately compares 3DHYAP with 3DHYAP_lite (2 versus 1 bit comparison). 3DHYAP_lite shows a slight additional latency compared to 3DHYAP at injection rates above 0.16, since it tends to misroute some flits compared to 3DHYAP since its priority comparison is less accurate than 3DHYAP.
In Figure 10 we see the same analysis for hotspot traffic. 3DPERM and 3DAPBLESS saturate very rapidly due to many deflections in the central routers and are not shown. Hotspot traffic is, as expected, more demanding on the network, forcing hops and latency to increase starting from the low injection rates. This has the effect of 3DBASE featuring higher latency than 3DHYAP almost immediately, the only exception being the very low injection rate of 0.04. 3DHYAP eventually reaches the saturation threshold at an injection rate of 0.2 due to many deflections while 3DBUFFBLESS after 0.24, proving the least vulnerable to saturation.
Figure 11 presents simulation results for transpose traffic. All router average latencies are close to the zero-load latency injection rates below 0.12. However, 3DBASE reaches the saturation threshold at 0.16 while 3DHYAP at 0.2 which is a relative increase of the saturation threshold by 25% compared to 3DBASE and 3DBUFFBLESS at approximately 0.22. It must be noted that the differences between 3DHYAP and 3DHYAP_lite as well as 3DHYAP and 3DBUFFBLESS versions for buffer sizes above 1 flit, are imperceptible and are not shown in the diagram for simplicity. This is likely because at low injection rates they are very close, but when saturation begins they all saturate rapidly.
From the above diagrams, we can generalize that 3DBUFFBLESS and 3DHYAP feature higher zero-load latency than 3DBASE. However, 3DBUFFBLESS degrades much more gracefully as injection rate increases than 3DBASE, with 3DHYAP somewhere in the middle.
4.3. Simulation Using Real Traffic Patterns
Real data transmission of NoCs are much less regular than synthetic traffic patterns. In order to capture the performance of the proposed router under these conditions, we implemented the Multi-Constraint System-Level (MCSL) NoC Traffic Patterns proposed in [20] on our 3D design to capture its performance. Due to the long simulation times required we compare 3DBASE with 3DHYAP only. We have used two applications as benchmarks, namely “ROBOT” which is the Newton-Euler dynamic control calculation for the 6-degrees-of- freedom Stanford manipulator comprising 88 tasks and 131 communication links and “H264-1080p_dec” which is an H.264 video decoder with a resolution of 1080p comprising 5,191 tasks and 7,781 communication links.
Figure 12 and Figure 13 show the average end-to-end latency as a function of the injection rate for the H.264 video decoder application and the Robot application respectively. In general, the trends observed using synthetic traffic patterns are present here too: 3DBASE reaches saturation first, followed by 3DHYAP with 3DBUFFBLESS being the last to saturate. One pronounced difference is that now 3DBASE features higher latency in cycles from the start even at very low injection rates.
5. Experimental Results—Hardware Evaluation
In this section we show and discuss extensively implementation results from synthesizing the proposed router and its counterparts in the Nangate 45nm library [21]. Then we combine the hardware performance with the simulations of the previous section to obtain latency in nanoseconds for each router, instead of cycles.
5.1. Performance Evaluation
Table 5 compares 3DHYAP with 3DPERM, 3DBUFFBLESS and 3DAPBLESS in terms of maximum operating frequency in GHz for flit widts of 32, 64 and 128 bits.
Table 5.
Maximum Frequency Comparison.
| Flit size (bits) | Maximum Operating Frequency (GHz) | |||
|---|---|---|---|---|
| 3DPERM | 3DBUFFBLESS | 3DAPBLESS | 3DHYAP | |
| 32 | 1.115 | 1.412 | 1.781 | 1.710 |
| 64 | 1.114 | 1.391 | 1.650 | 1.619 |
| 128 | 1.100 | 1.371 | 1.638 | 1.607 |
From the above table, it can be seen that 45nm implementation results generally agree with the results of the analysis of subsection 3.1. Specifically, 3DHYAP achieves an improvement of about 48% in maximum operating frequency, compared to 3DPERM and 20% compared to 3DBUFFBLESS depending on flit size. These results are consistent with the predictions of equations (1), (3) and (4).
Figure 14 and Figure 15 revisit the simulation results of section 4.2, Figure 9, Figure 10 and Figure 11 but now the latency is given in ns after multiplying the cycles of each router by its clock period corresponding to the operating frequencies of Table 4.
Figure 14 shows that 3DHYAP outperforms the other routers until the injection rate of 0.24 flits per cycle per node where saturation begins. Similarly, Figure 15 shows that 3DHYAP outperforms 3DBUFFBLESS until the injection rate of 0.2 flits per cycle per node where saturation begins. In other words, when clock period is taken into account, 3DHYAP provides the lowest latency as predicted.
5.1. Area Evaluation
Figure 16 compares routers in terms of area in a 45nm technology. It can be seen that with a buffer size of one flit, 3DBUFFBLESS is more area efficient than 3DPERM, achieving an area reduction of 20%, roughly in accord with equation 2. Increasing the buffer size to two flits offsets the gains of using a smaller permutation network due to the size of the buffers which are not taken into account in equation 2, while a buffer size of 4 flits increases this even more dramatically, leading to an increase of area of 25% and 40% respectively.
However, our simulations have shown that even with a buffer size of one flit, 3DHYAP outperforms 3DBUFFBLESS and 3DPERM in latency, while increasing the buffer size does not significantly add benefit, the bufferless ports dominated the buffered ones when saturation begins. This causes the network to saturate at approximately the same injection rate, independent of buffer size. Therefore, the minimum buffering of one flit is preferred.
6. Discussion
This paper presented the exploration of combining partially buffered routing in the z dimension of a 3D router, with approximate priority deflection routing in the x and y dimensions. From the combination of high-level simulation with hardware implementation the key results summarized below were obtained:
Firstly, minimal buffering in the z dimension significantly increases the saturation threshold in a 3D mesh topology compared to completely bufferless routing. However, somewhat counterintuitively, additional buffering has minimal effect as also demonstrated in [17].
Secondly, the reduction of the bufferless routing two four ports instead of six, significantly reduces the critical path delay, and therefore increases the clock frequency.
Thirdly, adding approximate priority comparison further increases clock frequency and reduces router area at the expense of somewhat lower saturation latency.
Finally, the zero-load latency of the partially buffered routers is somewhat higher than the bufferless ones due to the buffered ports. However, this is likely to be improved by adding pipeline stages, which is left for exploration in the future.
Author Contributions
Conceptualization, K.T.; methodology, K.T. and S.S.; software, S.S.; validation, S.S. and K.T.; formal analysis, K.T.; investigation, S.S.; resources, C.K.; writing—original draft preparation, K.T. and S.S; writing—review and editing, C.K. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest.
Abbreviations
| NoC | Network-on-Chip |
| URT | Uniform Random Traffic |
| ASIC | Application-Specific Integrated Circuit |
| PSRNG | Pseudo-Random Number Generator |
References
- Tatas, K.; Siozios, K.; Soudris, D.; Jantch, A. Designing 2D and 3D Network-on-Chip Architectures; Springer: New York, NY, USA, 2014. [Google Scholar]
- Wang, L.; Ma, S.; Li, C.; Chen, W.; Wang, Z. A High Performance Reliable NoC Router, Integration 2017, 58, 583-592. [CrossRef]
- Benini, L.; De Micheli, G. Networks on Chips: A Circuit and Systems Perspective, Morgan Kaufmann, 2006. 2006. [Google Scholar]
- Jafari, F.; Lu, Z.; Jantsch, A.; Yaghmaee, M.H. Optimal regulation of traffic flows in network-on-chip. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE), Dresden, Germany, 8–12 March 2010. [Google Scholar] [CrossRef]
- Jafari, F.; Lu, Z.; Jantsch, A.; Yaghmaee, M.H. Buffer Optimization in Network-on-Chip Through Flow Regulation. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 2010; 29, 1973–1986. [Google Scholar] [CrossRef]
- Park, J.; O’Krafka, B. W.; Vassiliadis, S.; Delgado-Frias, J. Design and evaluation of a DAMQ multiprocessor network with self-compacting buffers. In Proceedings of the 1994 ACM/IEEE Conference on Supercomputing, Washington, DC, USA, 14-18 November 1994; pp. 713–722. [Google Scholar] [CrossRef]
- Nicopoulos, C.A.; Park, D.; Kim, J.; Vijaykrishnan, N.; Yousif, M.S.; Das, C.R. ViChaR: A dynamic virtual channel regulator for network-on-chip routers, In Proceedings of the 9th Annual International Symposium on Microarchitecture (MICRO), Orlando, FL, USA, December 9-13, 2006; pp. 333-344. [CrossRef]
- Ramanujam, R.; Soteriou, V.; Lin, B.; Peh, L.S. Design of a High-Throughput Distributed Shared-Buffer NoC Router, In Proceedings of Fourth ACM/IEEE International Symposium on Networks-on-Chip, Grenoble, France, 3-6 May 2010. [CrossRef]
- Tatas, K.; Savva, S.; Kyriacou, C. 3DBUFFBLESS: A Novel Buffered-Bufferless Hybrid Router for 3D Networks-on-Chip. In Proceedings of the 27th International Symposium on Power and Timing Modeling, Optimization and Simulation (PATMOS 2017),Thessaloniki, Greece, 25–27 September 2017. [CrossRef]
- Tatas, K. High-performance 3D NoC bufferless router with approximate priority comparison. In Proceedings of the 7th International Conference on Modern Circuits and Systems Technologies (MOCAST), Thessaloniki, Greece, 7–9 May 2018. [Google Scholar] [CrossRef]
- Jingcao, H.; Marculescu, R. Application-specific buffer space allocation for networks-on-chip router design, In Proceedings of the IEEE/ACM International Conference on Computer Aided Design (ICCAD), San Jose, CA, USA, 07-11 November 2004; pp. 354-361. [CrossRef]
- Kodi, A.; Louri, A.; Wang, J. Design of energy-efficient channel buffers with router bypassing for network-on-chips (NoCs), In Proceedings of the10th International Symposium on Quality Electronic Design, San Jose, CA, USA, 16-18 March 2009, pp. 826-832. [CrossRef]
- Moscibroda, T.; Mutlu, O. A Case for Bufferless Routing in On-Chip Networks. In Proceedings of the 36th Annual International Symposium on Computer Architecture, New York, NY, USA, 11–15 June 2009; pp. 196–207. [Google Scholar] [CrossRef]
- Fallin, C.; Craik, C.; Mutlu, O. Chipper: A low-complexity bufferless deflection router. In Proceedings of the 17th IEEE International Symposium on High Performance Computer Architecture, San Antonio, TX, USA, 12–16 February 2011; pp. 144–155. [Google Scholar] [CrossRef]
- Feng, C.; Lu, Z.; Jantsch, A.; Zhang, A. 1-Cycle 1.25GHz Bufferless Router for 3D Network-on-Chip, IEICE Transactions on Information and Systems 2012, E95.D(5), 1519-1522. [CrossRef]
- Jiang, X.; Zeng, L.; Watanabe, T. A Sophisticated Routing Algorithm in 3D NoC with Fixed TSVs for Low Energy and Latency. IPSJ Transactions on System LSI Design Methodology 2014, 7, 101-109. [CrossRef]
- Tatas, K.; Savva, S.; Kyriacou, C. 3DBUFFBLESS: A Novel Buffered-Bufferless Hybrid Router for 3D Networks-on-Chip, In Proceedings of the 27th International Symposium on Power and Timing Modeling, Optimization and Simulation (PATMOS 2017), Thessaloniki, Greece, September 25-27 2017. [CrossRef]
- Tatas, K. High-performance 3D NoC bufferless router with approximate priority comparison. In Proceedings of the 7th International Conference on Modern Circuits and Systems Technologies (MOCAST), Thessaloniki, Greece, 7–9 May 2018. [Google Scholar] [CrossRef]
- Ben-Itzhak, Y.; Zahavi, E.; Cidon, I.; Kolodny, A. HNOCS: Modular open-source simulator for Heterogeneous NoCs, In Proceedings of International Conference on Embedded Computer Systems (SAMOS), Samos, Greece, 16-19 July 2012, pp. 51–57. [CrossRef]
- Liu, W.; Xu, J.; Wu, X.; Ye, Y.; Wang, X.; Zhang, W.; Nikdast, M.; Wang, Z. A NoC Traffic Suite Based on Real Applications. In Proceedings of the IEEE Computer Society Annual Symposium on VLSI (ISVLSI), Chennai, India, 4-6 July 2011. [Google Scholar] [CrossRef]
- 15nm Open-Cell Library and 45nm FreePDK. Available online: https://si2.org/open-cell-library/ (accessed on 14 June 2022).
Figure 1.
Generic Buffered NoC N-port Router Architecture with virtual channels.
Figure 2.
Baseline 7-port router for 3D bufferless NoCs.
Figure 3.
Baseline 7-port router for 3D bufferless NoCs.
Figure 4.
3DBUFFBLESS architecture.
Figure 5.
3DBUFFBLESS and 3DHYAP injection/ejection block.
Figure 6.
3DHYAP selector block.
Figure 7.
3DHYAP permutation block.
Figure 8.
Reduced levels of logic using approximate comparison. (a) full comparison (b) 3DHYAP and (c) 3DHYAP_lite.
Figure 8.
Reduced levels of logic using approximate comparison. (a) full comparison (b) 3DHYAP and (c) 3DHYAP_lite.
Figure 9.
Router latency comparison in cycles for (a) uniform random traffic, (b) comparison between 3DHYAP and 3DHYAP_lite.
Figure 9.
Router latency comparison in cycles for (a) uniform random traffic, (b) comparison between 3DHYAP and 3DHYAP_lite.
Figure 10.
Router latency comparison in cycles for hotspot traffic.
Figure 11.
Router latency comparison in cycles for transpose traffic.
Figure 12.
Router latency comparison in cycles for the H.264-1080p video decoder benchmark.
Figure 13.
Router latency comparison in cycles for the H.264-1080p video decoder benchmark.
Figure 14.
Router latency comparison in ns for uniform random traffic.
Figure 15.
Router latency comparison in ns for (a) hotspot and (b) transpose traffic.
Figure 16.
Router area comparison in 45nm Nangate technology.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
MDPI Initiatives
Important Links
© 2024 MDPI (Basel, Switzerland) unless otherwise stated