IMX678C#
8MP/4K optical sensor module with Sony Starvis2 low-light image sensor.
Product Specification - Overview#
Sensor Module#
Type |
Sony IMX678-AAQR1 (AR) |
|---|---|
Shutter Type |
CMOS Rolling Shutter |
Technology |
Starvis2 |
Spectrum |
Color (RGB) |
Optical Format |
1/1.8” |
Pixel Size |
2 x 2 µm |
Resolution (max.) |
3840 x 2160 (4K / 8MP) |
Framerate (max.)* |
10Bit: 72.05 FPS 12Bit: 60.00 FPS |
Bit Depth* |
10 / 12 bit |
*Platform dependent
Platform Support (Driver, ISP)#
NVIDIA |
Jetson Xavier, Orin Family |
|---|---|
NXP |
i.MX8MP |
Lens Option(s)#
FOV (H) |
54° |
100° |
110° |
|---|---|---|---|
Optical Filter |
IR cut (650 nm) |
IR cut (660 nm) |
IR cut (650 nm) |
Aperture |
F/2 |
F/2.7 |
F/2 |
Lens Mount |
M12 x 0.5 |
M12 x 0.5 |
M12 x 0.5 |
Interface Option(s)#
Data Interface |
MIPI CSI 2 (D-PHY, v1.2) |
GMSL3 (12Gbps) |
|---|---|---|
Physical Interface |
PixelMate (60 pin) Micro Coax (50 pin) FFC (40 pin) (unshielded) |
FAKRA (Single Coax) |
Communication |
I2C |
I²C |
Power Supply |
Two Rails (3.8V, 1.8V) |
Power over Coax (12V) |
Power Cons. (Max) |
540mW |
1.2W |
Mechanical Specification#
Dimensions [mm] |
26.5 (W) x 26.5 (D) H: [min 4.81 – max 57.36] |
|---|---|
Housing |
None / Boardlevel |
Lens Mount |
M12 x 0.5 (var. options) |
Applications:#
Security and surveillance
Drones - AGV and AGVs
Streaming and conferencing
Sport analytics
Mapping, digital twins
Industrial, robotics
Environmental#
Ingress Protection |
None |
|---|---|
Operating Temperature |
-30° to +85°C* |
Storage Temperature |
-40°to +85°C* |
Ambient Humidity |
Max 95% RH, non-condensing |
*Sensor module without lens, check Lens Options for configurations with Lens.`
Order Code Scheme/Options#
FSM:GO-IMX678C-[LM]-[L]-[FS][FD]-[IF]-[MH]-A1Q1#
LM: Lens Holder (Optional)
M12A: 8.6 mm Height
M12B: 12.5 mm Height
M12C: 16.2 mm Height
M12D: 7.9 mm Height
L: Lens Type (Optional)
L54A: 54° HFOV (LM: M12B)
L100A: 100° HFOV (LM: M12B)
L110A: 110° HFOV (LM: M12B)
FS: Focusing Service (Optional)
FCS: Center Focusing (L: Required)
FD: Focusing Distance
HYP: Hyperfocal Distance
xxxx: Custom Distance in mm (FS: Required)
IF: Interface (Mandatory)
PM: PixelMate (60 pin)
MC50A: MicroCoax (50 pin)
FFC40A: Flat-Flex Cable (40 pin)
GMSL3A: GMSL3 (FAKRA, Single Coax)
MH: Mechanicals/Housing
None: Board Level
Lens Options#
Module Specification#
Lens Type (PN) |
FLP- AM-077-00-V-00 |
FLP- EM-044-00-V-00 |
FLP- AM-040-02-V-00 |
Field of View [°] |
|
|
|
Horizontal |
54 |
100 |
110 |
Vertical |
32 |
55 |
62 |
Diagonal |
61 |
114 |
127 |
Aperture (F-Number) |
F/2 |
F/2.7 |
F/2 |
Optical Filter |
IRC@650 (±10nm) |
IRC@660 | IRC@650 (±10nm) | (±10nm) |
|
Mount Thread |
M12 x 0.5 |
M12 x 0.5 |
M12 x 0.5 |
Mating Mount (PN) |
FLA -MI-M-12522-00 |
FLA -MI-M-12522-00 |
FLA -MI-M-12522-00 |
Temperature Range |
-20°to +70°C* |
-40°to +85°C* |
-30°to +85°C* |
Sensor Coverage |
|
|
|
*Image tuning and assembly are performed at 25°C. Temperature variations may affect performance and focus.`
Lens Specification#
Focal length [mm] |
7.68 |
4.5 |
4 |
Min. Object Distance [m] |
0.1 |
0.1 |
0.3 |
Hyperfocal Distance [m] |
7.38 |
1.88 |
2.00 |
Max. Image Circle [mm] |
9.4 |
11.06 |
9.25 |
Back Focal Length [mm] |
8.86 |
7.33 |
6.5 |
Distortion [%] |
-2.19 (F-Tan-Theta) |
-35.8 (F-Tan-Theta) |
-0.177 (F-Theta) |
Rel. Illumination [%] |
55 |
86 |
30 |
Max. CRA [°] |
10.8 |
9.2 |
14.5 |
TTL [mm] |
33.62 |
29.64 |
31.61 |
Construction |
9 (Glass) |
7 (Glass) |
8-7 (Glass) |
Focusing Service and Focusing Distance#
Specification#
Description |
No Focusing 1 |
Focusing to Hyperfocal |
Focusing to Custom Distance |
|---|---|---|---|
Type (Code) |
N/A |
FCSHYP |
FCS[FD] |
Focus Distance |
N/A |
Hyperfocal Distance [HYP]2 |
Custom Focus Distance [FD]3 |
Focus Target |
N/A |
Virtual Image (Collimator) |
Virtual Image (Collimator) |
Focus Area 4 |
N/A |
Image Center |
Image Center |
Lens Fixation |
N/A |
Permanent (Epoxy) |
Permanent (Epoxy) |
1Lens is properly screwed into the lens mount without focusing and fixation.
2Please see “Hyperfocal Distance [m]” in Lens Specifications table.
3Please see “Min. Object Distance [m]” to infinity in Lens Specifications table.
4Please see Figure 3.1 below showing the virtual target at image center as the focus area.
Focus Area#
Lens Mount Options#
Specification#
Type (Code) |
M12A |
M12B |
M12C |
M12D |
|---|---|---|---|---|
Type (PN) |
FLA-MA -M-08622-00 |
FLA-MI -M-12522-00 |
FLA-MO -M-16222-00 |
FLA-M C-M-07922-00 |
Thread Type |
M12 x 0.5 |
M12 x 0.5 |
M12 x 0.5 |
M12 x 0.5 |
Height [mm] |
8.6 |
12.5 |
16.2 |
7.9 |
Barrel Diameter (Outer) [mm] |
13.8 |
13.8 |
14.5 |
14.5 |
Thread Length |
4.6 |
7.9 |
11.2 |
3 |
Mounting Hole Distance [mm] |
22 |
22 |
22 |
22 |
Mounting Screw Size |
M1.6 |
M1.6 |
M1.6 |
M1.6 |
Material |
PC+30%GF |
ABS |
C1200 PC/ABS |
PC+10%GF |
Appearance [Color] |
Black |
Black |
Black |
Black |
Mating Std. Lens (Code) |
NA |
L54A L100A L110A |
NA |
NA |
Interface Options#
Type (Code) |
PM |
MC50A |
FFC40A |
GMSL3A |
|---|---|---|---|---|
Description |
PixelMate |
Micro-Coax |
Flat-Flex Cable |
GMSL/SerDes |
FSM:GO Integration |
Default FSM:GO Interface |
Adapter Board (Piggyback) |
Adapter Board (Piggyback) |
Adapter Board (Piggyback) |
Interface Standard |
FRAMOS PixelMateC |
Proprietary |
Proprietary |
GMSL, FAKRA Coaxial |
Connector Type |
Hirose DF40C-60 DP-0.4V(51) |
I-PEX 20 525-050E-02 |
Molex 5051104091 |
Amphenol RF 2FA1 -NZSP-PCBB6 |
Pin Count [#] |
60 |
50 |
40 |
1+GND |
Pin Pitch [mm] |
0.4mm |
0.4mm |
0.5mm |
NA |
Locking Style |
S elf-Locking |
Mechanical locking |
Mechanical locking |
Mechanical locking |
Shielding |
Yes |
Yes |
No |
Yes |
Power Supply [V] |
3V8, 1V8 |
3V8, 1V8 |
3V8, 1V8 |
12V (Power over Coax) |
Data Lanes /Bandwidth |
4-Lanes, 2.5 Gbps (ea.) |
4-Lanes, 2.5 Gbps (ea.) |
4-Lanes, 2.5 Gbps (ea.) |
1-Line at 12Gbps (10Gbps Effective) |
Mating Connector |
Hirose DF40C-60 DS-0.4V(51) |
I-PEX 20 525-050E-02 |
Molex 5051104091 |
Amphenol RF 2FA1 -NZSP-PCBB6 |
Mating Cable(s) |
FM A-FC-150/60 |
FMA-CB L-MC50-0.3m |
Molex 0150200440 |
FMA-CBL-F AK.LD302-* |
Receiver Boards |
Various FPAs |
FFA-MC50/A |
FFA-FFC40/A |
FFA- GMSL-DES-V2 |
Pinouts#
WARNING Pin 1 is identified on the board. Orient accordingly, paying close attention to the pin number in reference to the locater view illustrated below. Failure to align correctly will cause permanent damage.
PixelMate:#
Type: Hirose DF40C-60DP-0.4V(51) |
Pinout |
Pinout |
||
|---|---|---|---|---|
1 |
3V8_VDD |
2 |
1V8_VDD |
|
3 |
3V8_VDD |
4 |
1V8_VDD |
|
5 |
NC |
6 |
NC |
|
7 |
NC |
8 |
NC |
|
9 |
NC |
10 |
NC |
|
11 |
GND |
12 |
GND |
|
13 |
GND |
14 |
GND |
|
15 |
IS_RST_0 |
16 |
NC |
|
17 |
NC |
18 |
NC |
|
19 |
XMASTER |
20 |
TOUT1 |
|
21 |
I2C_SCL |
22 |
NC |
|
23 |
NC |
24 |
NC |
|
25 |
XVS |
26 |
NC |
|
27 |
I2C_SDA |
28 |
NC |
|
29 |
XHS |
30 |
TENABLE |
|
31 |
NC |
32 |
TOUT0 |
|
33 |
NC |
34 |
NC |
|
35 |
SLAMODE0 |
36 |
SLAMODE1 |
|
37 |
GND |
38 |
GND |
|
39 |
NC |
40 |
NC |
|
41 |
NC |
42 |
NC |
|
43 |
GND |
44 |
GND |
|
45 |
NC |
46 |
D_DATA_3_P |
|
47 |
NC |
48 |
D_DATA_3_N |
|
49 |
GND |
50 |
GND |
|
51 |
D_DATA_0_N |
52 |
D_DATA_1_N |
|
53 |
D_DATA_0_P |
54 |
D_DATA_1_P |
|
55 |
GND |
56 |
GND |
|
57 |
D_DATA_2_P |
58 |
D_CLK_0_P |
|
59 |
D_DATA_2_N |
60 |
D_CLK_0_N |
MC50:#
Type: I-PEX 20525-050E-02 |
Pinout |
Pinout |
||
|---|---|---|---|---|
1 |
GND |
2 |
I2C_SDA |
|
3 |
D_CLK_0_N |
4 |
NC |
|
5 |
D_CLK_0_P |
6 |
XVS |
|
7 |
GND |
8 |
NC |
|
9 |
D_DATA_2_N |
10 |
NC |
|
11 |
D_DATA_2_P |
12 |
I2C_SCL |
|
13 |
GND |
14 |
TOUT1 |
|
15 |
D_DATA_1_P |
16 |
XMASTER |
|
17 |
D_DATA_1_N |
18 |
NC |
|
19 |
GND |
20 |
NC |
|
21 |
D_DATA_0_P |
22 |
NC |
|
23 |
D_DATA_0_N |
24 |
IS_RST_0 |
|
25 |
GND |
26 |
GND |
|
27 |
D_DATA_3_N |
28 |
NC |
|
29 |
D_DATA_3_P |
30 |
NC |
|
31 |
GND |
32 |
NC |
|
33 |
NC |
34 |
NC |
|
35 |
SLAMODE1 |
36 |
NC |
|
37 |
SLAMODE0 |
38 |
NC |
|
39 |
NC |
40 |
GND |
|
41 |
NC |
42 |
1V8_VDD |
|
43 |
TOUT0 |
44 |
1V8_VDD |
|
45 |
NC |
46 |
GND |
|
47 |
TENABLE |
48 |
3V8_VDD |
|
49 |
XHS |
50 |
3V8_VDD |
FFC40:#
Type: Molex 5051104091 |
Pinout |
Pinout |
||
|---|---|---|---|---|
1 |
GND |
2 |
NC |
|
3 |
D_CLK_0_N |
4 |
XHS |
|
5 |
D_CLK_0_P |
6 |
XVS |
|
7 |
GND |
8 |
I2C_SDA |
|
9 |
D_DATA_2_N |
10 |
I2C_SCL |
|
11 |
D_DATA_2_P |
12 |
XMASTER0 |
|
13 |
GND |
14 |
IS_RST_0 |
|
15 |
D_DATA_1_P |
16 |
NC |
|
17 |
D_DATA_1_N |
18 |
NC |
|
19 |
GND |
20 |
NC |
|
21 |
D_DATA_0_P |
22 |
NC |
|
23 |
D_DATA_0_N |
24 |
NC |
|
25 |
GND |
26 |
NC |
|
27 |
D_DATA_3_N |
28 |
GND |
|
29 |
D_DATA_3_P |
30 |
1V8_VDD |
|
31 |
GND |
32 |
1V8_VDD |
|
33 |
NC |
34 |
GND |
|
35 |
GND |
36 |
3V8_VDD |
|
37 |
NC |
38 |
3V8_VDD |
|
39 |
NC |
40 |
GND |
GMSL3A:#
Type: 2FA1-NZSP-PCBB6 |
Pinout |
|
|---|---|---|
1 |
GMSL_SIOP |
|
2 |
GND |
Signal Description#
3V8_VDD I/O Type Power Function 3.8V Power supply Connected to LDO_IC DC Charact. 3V8_VDD=3.7V-5.1V, max. 0.3A per line |
1V8_VDD I/O Type Power Function 1.8V Power supply Connected to LDO_IC DC Charact. 1V8_VDD=1.7V-1.9V, max. 0.3A per line |
IS_RST_0 I/O Type IN Function Image sensor reset (XCLR) Connected to Reset_IC I/O Standard LVCMOS18 (1.8V) I/O State Normal: High, Reset: Low DC Charact. VILmax=0.36V, VIHmin=1.44V |
SLAMODE0/1 I/O Type IN Function I2C slave address configuration Connected to Image Sensor, pull-down res. 10k I/O Standard LVCMOS18 (1.8V) DC Charact. VILmax=0.36V, VIHmin=1.44V |
I2C_SCL I/O Type IN/OUT Function I2C clock Connected to Image Sensor, no pull-up I/O Standard LVCMOS18 (1.8V) DC Charact. VILmax=0.54V, VIHmin=1.26V |
I2C_SDA I/O Type IN/OUT Function I2C data Connected to Image Sensor, no pull-up I/O Standard LVCMOS18 (1.8V) DC Charact. VILmax=0.36V, VIHmin=1.44V |
XMASTER I/O Type IN Function Image sensor master/slave Connected to Image Sensor, pull-down res. 10k I/O Standard LVCMOS18 (1.8V) DC Charact. VOLmax=0.36, VOLmin=1.44V |
XVS / XHS I/O Type IN/OUT Function Vertical/Horizontal sync signal Connected to Image Sensor, pull-up res. 10k I/O Standard LVCMOS18 (1.8V) DC Charact. VILmax=0.36V, VIHmin=1.44V, VOLmax=0.2V, VOHmin=1.6V |
TENABLE I/O Type IN Function Test enable Connected to Image Sensor I/O Standard LVCMOS18 (1.8V) DC Charact. VILmax=0.36V, VIHmin=1.44V |
TOUT0/1 I/O Type OUT Function Test output pins from image sensor Connected to Image Sensor I/O Standard LVCMOS18 (1.8V) DC Charact. VILmax=0.36V, VIHmin=1.44V |
D_DATA_#_P/N I/O Type OUT Function MIPI-CSI2 output data (Lane #, Positive/Negative) Connected to Image sensor I/O Standard MIPI D-PHY |
D_CLK_0_P/N I/O Type OUT Function MIPI-CSI2 output clock (Positive/Negative) Connected to Image sensor I/O Standard MIPI D-PHY |
I2C Address Configuration (SLAMODE)#
SLAMODE0 |
SLAMODE1 |
I2C Address |
|---|---|---|
0 |
0 |
0x1A |
1 |
0 |
0x10 |
0 |
1 |
0x36 |
1 |
1 |
0x37 |
Power-On Sequencing#
For correct function, the host system must follow the below timing to properly power up or reset the module
3V8_VDD should be generated after 1V8_VDD, or, ideally at the same time. RST_0 pin low after powering up PixelMate voltage rails; 180 ms.
Legend#
Times and voltages which are represented in the above figure are as follows:
3V8_VDD - 3V8 voltage supply from host
1V8_VDD - 1V8 voltage supply from host
RST_0 - reset signal driven from the host
I2C_SCL - I2C Clock
I2C_SDA - I2C Data
Mechanical Drawings#
The following chapter contains the measured drawings split into the core segments of the product.
Bare Sensor Module
with Lens
with Lens Mount only
with Interface Adapter
All measures refer to the backside of the sensor module PCB and alow this way to obtain the overall measures. Unit of measurements is milimeters [mm].
Sensor Module (Bare FSM:GO)#
Interface: PixelMate#
FSM:GO with Lens#
L54A:#
54° HFOV (LH: M12B)
L100A:#
100° HFOV (LH: M12B)
L110A:#
110° HFOV (LH: M12B)
FSM:GO with Mount#
M12A:#
8.6 mm Height
M12B:#
12.5 mm Height
M12C:#
16.2 mm Height
M12D:#
7.9 mm Height (wider fitting)
FSM:GO with Interface Adapter#
PM: See Bare Sensor Module
NOTE Interface adapters fixed with screws for transport, mounting screws not included in product photos and drawings.
MC50A: MicroCoax (50 pin)
FFC40A: Flat-Flex Cable (40 pin)
GMSL3A (FAKRA, Single Coax)
Platform & Software Specification#
NVIDIA Jetson Family Support#
Supported Platforms:
Jetson AGX Xavier Devkit |
Jetson Xavier NX Devkit |
Jetson AGX Orin Devkit |
Jetson Orin Nano & Jetson Orin NX Devkits |
|||||
|---|---|---|---|---|---|---|---|---|
Image Sensor |
Support (Native) |
GMSL |
Support (Native) |
GMSL |
Support (Native) |
GMSL |
Support (Native) |
GMSL |
IMX678 |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Supported Features:
Mode |
Resolution |
Description |
2lane/10b[FPS] |
2lane/12b[FPS] |
4lane/10b[FPS] |
4lane/12b[FPS] |
|---|---|---|---|---|---|---|
0 |
3856x2180 |
FULL_PIX |
30.0 |
30.0 |
72.1 |
60.0 |
1 |
2608x1964 |
CROP |
33.2 |
33.2 |
79.7 |
66.4 |
2 |
1920x1080 |
CROP |
58.7 |
58.7 |
140.9 |
117.4 |
3 |
1928x1090 |
BINNING H2V2 |
NA |
30.0 |
NA |
60.0 |
Implemented Sensor Features:
Sensor Feature |
Support |
|---|---|
Gain (Analog/Digital) |
Yes |
Frame Rate |
Yes |
Exposure |
Yes |
Flip/Mirror |
NA |
IS Mode (Master/Slave) |
Yes |
Sensor Mode ID |
Yes |
Test Pattern |
Yes |
Black Level |
Yes |
Clear HDR |
NA |
Broadcast |
Yes |
Data Rate |
Yes |
Synchronizing (Master/Slave) |
Yes |
Supported ISP Features:
Image Signal Processing Feature |
Support |
|---|---|
Demosaic |
Yes |
Black Level Compensation |
Yes |
Bad Pixel Correction |
Yes |
Color Correction |
Yes |
Auto White Balance (A, TL84, D65) |
Yes |
Manual White Balancing |
Yes |
Lens Shading/Falloff Correction |
Yes |
Noise Reduction |
Yes |
Sharpening |
Yes |
Auto Exposure, Gain, Gamma, Color/Tone, Contrast Tuning |
Yes |
NXP i.MX8MP Support#
Supported Platforms:
i.MX 8M PLUS Devkit |
|||
|---|---|---|---|
Image sensor |
Driver |
Support (Native) |
GMSL |
IMX678 |
IMX678 |
Yes |
NA |
Supported Features:
Mode |
Resolution |
Description |
4lane/10b [FPS] |
4lane/12b [FPS] |
|---|---|---|---|---|
0 |
3840x2160 |
FULL_PIX |
25 (720 Mbps) 30 (891 Mbps) |
25 (891 Mbps) 30 (1188 Mbps) |
1 |
1920x1080 |
BINNING H2V2 + CROP |
NA |
30 (720 Mbps) |
Implemented Features:
Supported Features |
FSM:GO-IMX678C |
|---|---|
Gain (Analog/Digital) |
Yes |
Frame Rate |
Yes |
Exposure |
Yes |
Flip/Mirror |
NA |
IS Mode (Master/Slave) |
NA |
Sensor Mode ID |
Yes |
Test Pattern |
Yes |
Black Level |
Yes |
HDR |
NA |
Broadcast |
NA |
Data Rate |
Yes |
Synchronizing Master mode |
Yes |