MIC-743 AI Inference System

AI Inference System Accelerated by NVIDIA® Jetson Module

Embedded with NVIDIA® Jetson Thor™ or T5000™ module, up to 2070 TFLOPS (FP4)
Supports 1 x QSFP28 (4 x 25GbE)
Supports 1 x 5GbE, 4 x USB 3.2 Gen 2, 1 x M.2 AEkey(WiFi), 1 x M.2 Bkey (LTE)
Support multiple purpose of large AI model for Generative AI application

Datasheets:

Processor System
CPU: 14 core Arm® Neoverse V3AE (64-bit) SMP CPU architecture
L1 Cache (I, D) per core: 64KB + 64KB, L2 1MB, L3 16MB
GPU: 2560 NVIDIA® CUDA® cores 96 5th Gen Tensor cores MAXN: 1.57 GHz
Memory: 128GB LPDDR5X

Ethernet
RJ45: 1 x 10/100/1000/2500/5000 Mbps Ethernet
QSFP28: 4 x 25GbE

I/O
Display: HDMI (Max. resolution 3840×2160 @ 60Hz)
USB: 4 x USB 3.2 Gen 2
OTG USB: 1 x Micro USB
Console: 1 x microUSB console for debug (UART to USB)
Audio: 1 x audio speaker out, MIC in on board
SIM card: 1 x Nano SIM on side of board

Expansion
M.2 Ekey: 1 x 2230 E-key (Signal: PCIex1 + USB2.0)
M.2 Bkey: 1 x 3052/3042 B-key (Signal: USB3.0 + USB2.0)
TPM ( Optional): 1 x TPM (onboard)

Storage
M.2: 1 x M.2 2280 (M-Key, NVMe, Signal: PCIe x4)

Power
Input: 19-36V
Power Type: Terminal Block 2 Pin
Internal pin header: 3 x SMART FAN

Environment
Operating Temperature: -10 ~ 35 °C with 0.7 m/s air flow
Operating Humidity: 95% @ 40 °C (non-condensing)
Vibration: 3 Grms @ 5 ~ 500 Hz, random, 1 hr/axis

Mechanical
Dimension (W x H x D): 195 x 200 x 71.5 mm with rubber foot
Weight: 2kg
Installation: Desktop

Operating System
JetPack: NVIDIA JetPack 7.0

Certification
EMC, Safety: CB/UL/CE/FCC/BSMI/CCC (No RED certification)