MikroTik CCR2004-1G-2XS-PCIe is a 2x SFP28 25GbE Router on a PCIe Card

 File this under “things that have us intrigued.” The MikroTik CCR2004-1G-2XS-PCIe combines an Arm CPU with dual 25GbE SFP28 cages to make a PCIe card that is also a router and can function as a router as well as a network adapter.

MikroTik CCR2004-1G-2XS-PCIe Router on a PCIe Card
For key specs, this is a low-profile PCIe Gen3 x8 card that is actively cooled. The card itself has a quad-core Annapurna Labs (now Amazon) AL32400 CPU, like the CCR2004. Attached to that are 4GB of DDR4 memory and 128MB of NAND for storage. Frankly, these two may be the most disappointing of the features. This card with more memory and storage would have a much wider use case than just routing.

Here is the block diagram regarding what is going on:

Basically, the AL32400 can pass through the SFP28 25GbE ports, as well as the 1GbE port (for management) to the host system. Also, the AL32400 CPU will have access to the external ports as well as ports connected to the host machine. Checking the STH back-end, we have a picture of one of these CPUs from the Ubiquiti UniFi USW-Leaf piece. Ubiquiti, for its part, took our feedback, along with some others, and decided to pivot that line. Still, we have a picture of one of these chips because of it. The AL324 uses 4x Arm Cortex-A57 cores for those wondering.

Unlike many of the DPU options, this is a very low-cost CPU. The last we heard was $20-25/ chip but that may have changed. MikroTik says it can pass line speed traffic if using jumbo frames. Still, with some DPUs and SmartNICs, memory bandwidth is a key limiting factor with this generation. BlueField 1 DPUs actually could have more bandwidth than today’s BlueField-2 cards, but we expect that to change in the future.

As we can see from the photo above, the card itself is actively cooled and draws power from the motherboard.

Final Words
For those thinking this is a DPU, it is not quite in that class. The card itself needs to boot, and that can take longer than the server. That will require additional work on servers to ensure this device gets picked up after it is ready. You know this is going to be an interesting card when the 3-page announcement includes a reference to how to re-initialize devices in Linux to be able to use the card:

Cards like the Mellanox NVIDIA BlueField-2 DPU use multi-host adapter functions to solve this problem. With BlueField-2 and some others, the host system gets to access the ConnectX NIC while the ARM CPU subsystem boots, then when that is online it is connected to the same multi-host adapter logic. We are going to have a lot more on BlueField-2 and other solutions soon on STH as our new special test platform is in the lab. If these sell for the rumored $200 list price then we may have more than one coming.

Overall, this is a really interesting device. It is focused on running a low-cost RouterOS instance on the Arm CPU. Imagine the possibilities though with a Ubuntu OS M.2 storage and two SODIMMs for memory. We will get one of these as soon as we can.

via servethehome