Research Article
Accelerated and Highly Correlated ASIC Synthesis of AI Hardware Subsystems Using CGP
Table 3
Four data format configurations used for inputs in the six activation functions represented as (integer part, fractional part) bits in a n-bit number.
| Function | Config-1 | Config-2 | Config-3 | Config-4 |
| Sigmoid, ReLU, GeLU, Softplus | (n − 1, 0) | (3, n − 4) | (n − ⌊n/2⌋ − 1, ⌊n/2⌋) | (n − ⌊n/2⌋ − 1, ⌊n/2⌋ − 1) | Tanh | (n − 1, 0) | (2, n − 3) | (n − ⌊n/2⌋ − 1, ⌊n/2⌋) | (n − ⌊n/2⌋ − 1, ⌊n/2⌋ − 1) | Gaussian | (n − 1, 0) | (1, n − 2) | (n − ⌊n/2⌋ − 1, ⌊n/2⌋) | (n − ⌊n/2⌋ − 1, ⌊n/2⌋ − 1) |
|
|