SOFT IP / DISPLAY & MULTIMEDIA / ISP

ISP  ·  Image Signal Processor

Configurable RAW sensor to processed image pixel pipeline  ·  WIOWIZ IP and WIOWIZ VIP

From RAW Bayer sensor pixels to a YUV image stream

A configurable pixel-processing pipeline that consumes MIPI CSI-2 RAW Bayer samples and produces a YUV (or RGB) stream. Pixels flow through black-level correction, defect-pixel correction, Bayer demosaic, auto-white-balance gain, a colour-correction matrix, a gamma tone LUT and an RGB to YUV colour-space convert. Every stage is programmed over an APB4 CSR, data moves on an AXI-Stream interface, and one output pixel is produced per RAW pixel.

APB4 CSR  ·  pipeline enables and bypass, frame geometry, CCM / CSC coefficients, gamma LUT RAW BAYER DOMAIN RGB DOMAIN YUV BLC Black level per colour Window 3x3 line store DPC Defect pixel hot / dead Demosaic Bilinear RAW to RGB AWB White balance Q8.8 gain CCM Colour matrix 3x3 + offset Gamma Tone LUT 256 entry CSC RGB to YUV 3x3 matrix AXI-Stream RAW in and YUV out  ·  status, frame counter and interrupt RAW YUV
Clean architectural view. Real parameters from the WIOWIZ ISP RTL.

Specifications

CategoryImage Signal Processor, RAW Bayer to YUV pixel pipeline
Pipeline stagesBlack level, defect pixel, Bayer demosaic, white balance, colour correction, gamma, RGB to YUV
InputMIPI CSI-2 RAW Bayer, 8-bit samples, AXI-Stream, raster order
OutputYUV or RGB, 24-bit packed pixel, AXI-Stream, per-frame last and interrupt
Bayer phasesRGGB, GRBG, GBRG, BGGR, selectable per frame
Pixel format8-bit components, 24-bit packed pixel
DemosaicBilinear over a 3x3 neighbourhood, round to nearest
Defect correctionDynamic hot and dead pixel, 3x3 outlier versus threshold
White balancePer-channel gain, 16-bit unsigned Q8.8, clamp
Colour and space convertShared 3x3 signed MAC, 18-bit Q<int>.8 coefficients, for CCM and RGB to YUV
Gamma256-entry 8-bit tone LUT, CSR loaded
Frame geometryUp to 65535 by 65535 pixels
ThroughputOne output pixel per RAW pixel
Host interfaceAPB4 CSR, 12-bit address, 32-bit data
VerificationUVM VIP, golden reference model scoreboard, functional coverage
OwnershipWIOWIZ IP and WIOWIZ VIP

Key features

Complete RAW to YUV path

Sensor RAW Bayer enters, a full YUV image stream leaves, no host CPU in the pixel loop.

Bilinear demosaic

Full R, G and B reconstructed at each site from a 3x3 window and the Bayer phase.

White balance and colour

Per-channel AWB gain feeds a programmable 3x3 colour-correction matrix with offset.

Defect pixel correction

Dynamic hot and dead pixel detection replaces outliers against a configurable threshold.

Programmable gamma

A 256-entry tone LUT, loaded over the CSR, shapes the response before colour convert.

Streaming and verified

AXI-Stream in and out, APB4 control, UVM VIP with golden-model scoreboard and coverage.

Applications

Camera SoCADAS and automotive visionMobile and IoT imagingMachine visionVideo capture pipelineSensor bridge
Request IP details