際際滷

際際滷Share a Scribd company logo
Post-processing of JPEG
image using MLP
Fall 2003 ECE539
Final Project Report
Data Fok
Overview
 Introduction
 Approach
 Experiments & Results
 Conclusion
 Demo
Introduction
 Increase demand on graphic usage
 Graphics: large file size
 JPEG compression blocking artifact
 Unpopularity of JPEG 2000
 Removal of JPEG artifact
Approach
 Multi Layer Perception
 15 inputs (5 x 3)
 5 R,G,B gradients of the neighbor pixels
close to the block border
 6 outputs (2 x 3)
 2 R,G,B different of the original image and
the compressed image on the pixels next to
the block border
Approach  cont.
Approach  cont.
 First order polynomial fit
 Use the 4 pixels closest to the block
border to estimate the value on the 2
pixels next to the border
 Use as a control experiment
Approach  cont.
 Image quality evaluate by
 Human eyes
 Peak signal to noise ratio (PSNR)
錚件7
錚
錚
錚錚
錚
錚
=
MSE
PSNR
255
log10 10
[ ]
( )2
,
2
),(),(
MN
yxIyxI
MSE
yx
 
=
Experiment & Result
 Optimal MLP structure after testing
 Structure: 15-5-6
 Learning rate = 0.01
 Momentum = 0.7
Experiment & Result  cont.
 Expt #1: grayscale image
 train and test with the same image
JPEG (0.14 bpp)
PSNR = 41.2044 (dB)
MLP postprocessed
PSNR = 40.2514 (dB)
Experiment & Result  cont.
 Expt #2: color image
 train and test with the same image
JPEG (0.18 bpp)
PSNR = 38.2464 (dB)
MLP postprocessed
PSNR = 37.9718 (dB)
Experiment & Result  cont.
 Expt #3: grayscale image
 train with a high bpp image, test with a low bpp image
JPEG (0.085 bpp)
PSNR = 39.5696 (dB)
MLP postprocessed
PSNR = 39.6552 (dB)
Experiment & Result  cont.
 Expt #4: color image
 train with a high bpp image, test with a low bpp image
 Training JPEG image bit rate = 0.374 bpp
JPEG (0.065 bpp)
PSNR = 37.4064 (dB)
MLP postprocessed
PSNR = 37.3664 (dB)
Experiment & Result  cont.
 Expt #5:
 train with a high bpp grayscale image,
test with a low bpp color image
 Training JPEG image bit rate = 0.255 bpp
JPEG (0.065 bpp)
PSNR = 37.4064 (dB)
MLP postprocessed
PSNR = 37.4312 (dB)
Experiment & Result  cont.
 Expt #6:
 train with a high bpp color image,
test with a low bpp grayscale image
 Training JPEG image bit rate = 0.255 bpp
JPEG (0.085 bpp)
PSNR = 39.5696 (dB)
MLP postprocessed
PSNR = 39.125 (dB)
Conclusion
 MLP can decrease blocking artifact
from experiment #3
 High quality image training data is
needed
 Current MLP structure does not suit
color image training data
 Further Study on the MLP structure
for color image
Demo
References
 W. B. Pennebaker and J. L. Mitchell, (1992) JPEG Still
Image Compression Standard. New York: Van Nostrand
Reinhold.
 Martin Boliek, Charilaos Christopoulos, Eric Majani,
(2000) JPEG 2000 Image Coding System, ISO/IEC
JTCI/SC29 WGI, http://www.jpeg.org/CDs15444.html
 Guoping Qiu, (2000) MLP for Adaptive Postprocessing
Block-Coded Images. IEEE Transactions On Circuits And
Systems For Video Technology, Vol. 10, No. 8,
December 2000
Q&A
Ad

Recommended

Jpeg dct
Jpeg dct
darshan2518
JPEG Image Compression
JPEG Image Compression
Hemanth Kumar Mantri
Next generation image compression standards: JPEG XR and AIC
Next generation image compression standards: JPEG XR and AIC
Touradj Ebrahimi
Image Compression
Image Compression
Forrester High School
Jpeg image compression using discrete cosine transform a survey
Jpeg image compression using discrete cosine transform a survey
IJCSES Journal
Multimedia image compression standards
Multimedia image compression standards
Mazin Alwaaly
JPEG
JPEG
RajatKumar471
Project presentation image compression by manish myst, ssgbcoet
Project presentation image compression by manish myst, ssgbcoet
Manish Myst
Digital Image Processing: Image Enhancement in the Frequency Domain
Digital Image Processing: Image Enhancement in the Frequency Domain
Mostafa G. M. Mostafa
Digital Image Processing: Image Enhancement in the Spatial Domain
Digital Image Processing: Image Enhancement in the Spatial Domain
Mostafa G. M. Mostafa
Seema dip
Seema dip
seemakashyap15
Comparison between JPEG(DCT) and JPEG 2000(DWT) compression standards
Comparison between JPEG(DCT) and JPEG 2000(DWT) compression standards
Rishab2612
Image Compression
Image Compression
Paramjeet Singh Jamwal
Jpeg
Jpeg
Anju Anjujosepj
Image enhancement
Image enhancement
Dr INBAMALAR T M
Digital image processing short quesstion answers
Digital image processing short quesstion answers
Ateeq Zada
//STEIM Workshop: A Vernacular of File Formats
//STEIM Workshop: A Vernacular of File Formats
Rosa 逼uk逼n
igarss2011.ppt
igarss2011.ppt
grssieee
Image enhancement techniques
Image enhancement techniques
Saideep
Digital Image Processing: Image Restoration
Digital Image Processing: Image Restoration
Mostafa G. M. Mostafa
image compression ppt
image compression ppt
Shivangi Saxena
Digital image processing - Image Enhancement (MATERIAL)
Digital image processing - Image Enhancement (MATERIAL)
Mathankumar S
Design of Image Compression Algorithm using MATLAB
Design of Image Compression Algorithm using MATLAB
IJEEE
DEMOSAICING OF REAL LOW LIGHTING IMAGES USING CFA 3.0
DEMOSAICING OF REAL LOW LIGHTING IMAGES USING CFA 3.0
sipij
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Norishige Fukushima
Image Enhancement in Spatial Domain
Image Enhancement in Spatial Domain
DEEPASHRI HK
Image compression standards
Image compression standards
kirupasuchi1996
Image enhancement
Image enhancement
vsaranya169
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Mark Billinghurst
Industrial internet of things IOT Week-3.pptx
Industrial internet of things IOT Week-3.pptx
KNaveenKumarECE

More Related Content

What's hot (20)

Digital Image Processing: Image Enhancement in the Frequency Domain
Digital Image Processing: Image Enhancement in the Frequency Domain
Mostafa G. M. Mostafa
Digital Image Processing: Image Enhancement in the Spatial Domain
Digital Image Processing: Image Enhancement in the Spatial Domain
Mostafa G. M. Mostafa
Seema dip
Seema dip
seemakashyap15
Comparison between JPEG(DCT) and JPEG 2000(DWT) compression standards
Comparison between JPEG(DCT) and JPEG 2000(DWT) compression standards
Rishab2612
Image Compression
Image Compression
Paramjeet Singh Jamwal
Jpeg
Jpeg
Anju Anjujosepj
Image enhancement
Image enhancement
Dr INBAMALAR T M
Digital image processing short quesstion answers
Digital image processing short quesstion answers
Ateeq Zada
//STEIM Workshop: A Vernacular of File Formats
//STEIM Workshop: A Vernacular of File Formats
Rosa 逼uk逼n
igarss2011.ppt
igarss2011.ppt
grssieee
Image enhancement techniques
Image enhancement techniques
Saideep
Digital Image Processing: Image Restoration
Digital Image Processing: Image Restoration
Mostafa G. M. Mostafa
image compression ppt
image compression ppt
Shivangi Saxena
Digital image processing - Image Enhancement (MATERIAL)
Digital image processing - Image Enhancement (MATERIAL)
Mathankumar S
Design of Image Compression Algorithm using MATLAB
Design of Image Compression Algorithm using MATLAB
IJEEE
DEMOSAICING OF REAL LOW LIGHTING IMAGES USING CFA 3.0
DEMOSAICING OF REAL LOW LIGHTING IMAGES USING CFA 3.0
sipij
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Norishige Fukushima
Image Enhancement in Spatial Domain
Image Enhancement in Spatial Domain
DEEPASHRI HK
Image compression standards
Image compression standards
kirupasuchi1996
Image enhancement
Image enhancement
vsaranya169
Digital Image Processing: Image Enhancement in the Frequency Domain
Digital Image Processing: Image Enhancement in the Frequency Domain
Mostafa G. M. Mostafa
Digital Image Processing: Image Enhancement in the Spatial Domain
Digital Image Processing: Image Enhancement in the Spatial Domain
Mostafa G. M. Mostafa
Comparison between JPEG(DCT) and JPEG 2000(DWT) compression standards
Comparison between JPEG(DCT) and JPEG 2000(DWT) compression standards
Rishab2612
Digital image processing short quesstion answers
Digital image processing short quesstion answers
Ateeq Zada
//STEIM Workshop: A Vernacular of File Formats
//STEIM Workshop: A Vernacular of File Formats
Rosa 逼uk逼n
igarss2011.ppt
igarss2011.ppt
grssieee
Image enhancement techniques
Image enhancement techniques
Saideep
Digital Image Processing: Image Restoration
Digital Image Processing: Image Restoration
Mostafa G. M. Mostafa
image compression ppt
image compression ppt
Shivangi Saxena
Digital image processing - Image Enhancement (MATERIAL)
Digital image processing - Image Enhancement (MATERIAL)
Mathankumar S
Design of Image Compression Algorithm using MATLAB
Design of Image Compression Algorithm using MATLAB
IJEEE
DEMOSAICING OF REAL LOW LIGHTING IMAGES USING CFA 3.0
DEMOSAICING OF REAL LOW LIGHTING IMAGES USING CFA 3.0
sipij
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Norishige Fukushima
Image Enhancement in Spatial Domain
Image Enhancement in Spatial Domain
DEEPASHRI HK
Image compression standards
Image compression standards
kirupasuchi1996
Image enhancement
Image enhancement
vsaranya169

Recently uploaded (20)

Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Mark Billinghurst
Industrial internet of things IOT Week-3.pptx
Industrial internet of things IOT Week-3.pptx
KNaveenKumarECE
20CE404-Soil Mechanics - 際際滷 Share PPT
20CE404-Soil Mechanics - 際際滷 Share PPT
saravananr808639
Mechanical Vibration_MIC 202_iit roorkee.pdf
Mechanical Vibration_MIC 202_iit roorkee.pdf
isahiliitr
Call For Papers - 17th International Conference on Wireless & Mobile Networks...
Call For Papers - 17th International Conference on Wireless & Mobile Networks...
hosseinihamid192023
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
moonsony54
System design handwritten notes guidance
System design handwritten notes guidance
Shabista Imam
Complete University of Calculus :: 2nd edition
Complete University of Calculus :: 2nd edition
Shabista Imam
NEW Strengthened Senior High School Gen Math.pptx
NEW Strengthened Senior High School Gen Math.pptx
DaryllWhere
FUNDAMENTALS OF COMPUTER ORGANIZATION AND ARCHITECTURE
FUNDAMENTALS OF COMPUTER ORGANIZATION AND ARCHITECTURE
Shabista Imam
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
resming1
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
Mark Billinghurst
Abraham Silberschatz-Operating System Concepts (9th,2012.12).pdf
Abraham Silberschatz-Operating System Concepts (9th,2012.12).pdf
Shabista Imam
Industry 4.o the fourth revolutionWeek-2.pptx
Industry 4.o the fourth revolutionWeek-2.pptx
KNaveenKumarECE
Stay Safe Women Security Android App Project Report.pdf
Stay Safe Women Security Android App Project Report.pdf
Kamal Acharya
Fatality due to Falls at Working at Height
Fatality due to Falls at Working at Height
ssuserb8994f
Microwatt: Open Tiny Core, Big Possibilities
Microwatt: Open Tiny Core, Big Possibilities
IBM
Unit III_One Dimensional Consolidation theory
Unit III_One Dimensional Consolidation theory
saravananr808639
Complete guidance book of Asp.Net Web API
Complete guidance book of Asp.Net Web API
Shabista Imam
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
resming1
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Rapid Prototyping for XR: Lecture 4 - High Level Prototyping.
Mark Billinghurst
Industrial internet of things IOT Week-3.pptx
Industrial internet of things IOT Week-3.pptx
KNaveenKumarECE
20CE404-Soil Mechanics - 際際滷 Share PPT
20CE404-Soil Mechanics - 際際滷 Share PPT
saravananr808639
Mechanical Vibration_MIC 202_iit roorkee.pdf
Mechanical Vibration_MIC 202_iit roorkee.pdf
isahiliitr
Call For Papers - 17th International Conference on Wireless & Mobile Networks...
Call For Papers - 17th International Conference on Wireless & Mobile Networks...
hosseinihamid192023
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
moonsony54
System design handwritten notes guidance
System design handwritten notes guidance
Shabista Imam
Complete University of Calculus :: 2nd edition
Complete University of Calculus :: 2nd edition
Shabista Imam
NEW Strengthened Senior High School Gen Math.pptx
NEW Strengthened Senior High School Gen Math.pptx
DaryllWhere
FUNDAMENTALS OF COMPUTER ORGANIZATION AND ARCHITECTURE
FUNDAMENTALS OF COMPUTER ORGANIZATION AND ARCHITECTURE
Shabista Imam
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
resming1
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
Rapid Prototyping for XR: Lecture 6 - AI for Prototyping and Research Directi...
Mark Billinghurst
Abraham Silberschatz-Operating System Concepts (9th,2012.12).pdf
Abraham Silberschatz-Operating System Concepts (9th,2012.12).pdf
Shabista Imam
Industry 4.o the fourth revolutionWeek-2.pptx
Industry 4.o the fourth revolutionWeek-2.pptx
KNaveenKumarECE
Stay Safe Women Security Android App Project Report.pdf
Stay Safe Women Security Android App Project Report.pdf
Kamal Acharya
Fatality due to Falls at Working at Height
Fatality due to Falls at Working at Height
ssuserb8994f
Microwatt: Open Tiny Core, Big Possibilities
Microwatt: Open Tiny Core, Big Possibilities
IBM
Unit III_One Dimensional Consolidation theory
Unit III_One Dimensional Consolidation theory
saravananr808639
Complete guidance book of Asp.Net Web API
Complete guidance book of Asp.Net Web API
Shabista Imam
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
resming1
Ad

Post processing of jpeg image using MLP

  • 1. Post-processing of JPEG image using MLP Fall 2003 ECE539 Final Project Report Data Fok
  • 2. Overview Introduction Approach Experiments & Results Conclusion Demo
  • 3. Introduction Increase demand on graphic usage Graphics: large file size JPEG compression blocking artifact Unpopularity of JPEG 2000 Removal of JPEG artifact
  • 4. Approach Multi Layer Perception 15 inputs (5 x 3) 5 R,G,B gradients of the neighbor pixels close to the block border 6 outputs (2 x 3) 2 R,G,B different of the original image and the compressed image on the pixels next to the block border
  • 6. Approach cont. First order polynomial fit Use the 4 pixels closest to the block border to estimate the value on the 2 pixels next to the border Use as a control experiment
  • 7. Approach cont. Image quality evaluate by Human eyes Peak signal to noise ratio (PSNR) 錚件7 錚 錚 錚錚 錚 錚 = MSE PSNR 255 log10 10 [ ] ( )2 , 2 ),(),( MN yxIyxI MSE yx =
  • 8. Experiment & Result Optimal MLP structure after testing Structure: 15-5-6 Learning rate = 0.01 Momentum = 0.7
  • 9. Experiment & Result cont. Expt #1: grayscale image train and test with the same image JPEG (0.14 bpp) PSNR = 41.2044 (dB) MLP postprocessed PSNR = 40.2514 (dB)
  • 10. Experiment & Result cont. Expt #2: color image train and test with the same image JPEG (0.18 bpp) PSNR = 38.2464 (dB) MLP postprocessed PSNR = 37.9718 (dB)
  • 11. Experiment & Result cont. Expt #3: grayscale image train with a high bpp image, test with a low bpp image JPEG (0.085 bpp) PSNR = 39.5696 (dB) MLP postprocessed PSNR = 39.6552 (dB)
  • 12. Experiment & Result cont. Expt #4: color image train with a high bpp image, test with a low bpp image Training JPEG image bit rate = 0.374 bpp JPEG (0.065 bpp) PSNR = 37.4064 (dB) MLP postprocessed PSNR = 37.3664 (dB)
  • 13. Experiment & Result cont. Expt #5: train with a high bpp grayscale image, test with a low bpp color image Training JPEG image bit rate = 0.255 bpp JPEG (0.065 bpp) PSNR = 37.4064 (dB) MLP postprocessed PSNR = 37.4312 (dB)
  • 14. Experiment & Result cont. Expt #6: train with a high bpp color image, test with a low bpp grayscale image Training JPEG image bit rate = 0.255 bpp JPEG (0.085 bpp) PSNR = 39.5696 (dB) MLP postprocessed PSNR = 39.125 (dB)
  • 15. Conclusion MLP can decrease blocking artifact from experiment #3 High quality image training data is needed Current MLP structure does not suit color image training data Further Study on the MLP structure for color image
  • 16. Demo
  • 17. References W. B. Pennebaker and J. L. Mitchell, (1992) JPEG Still Image Compression Standard. New York: Van Nostrand Reinhold. Martin Boliek, Charilaos Christopoulos, Eric Majani, (2000) JPEG 2000 Image Coding System, ISO/IEC JTCI/SC29 WGI, http://www.jpeg.org/CDs15444.html Guoping Qiu, (2000) MLP for Adaptive Postprocessing Block-Coded Images. IEEE Transactions On Circuits And Systems For Video Technology, Vol. 10, No. 8, December 2000
  • 18. Q&A