Underwater image enhancement has attracted attention for its importance in marine survey and underwater robotics. In the past few years,many underwater image enhancement algorithms have been proposed. The existing deep learning methods ignore the pre-processing process of underwater image and the enhancement of red channel information or weaken this process,resulting in insignificant enhancement results,which are often adapted to specific scenes only and lack the generalization capability. To this end,we establish a brand new underwater image enhancement algorithm based on convolutional neural network. In order to make full use of the channel information of feature maps,convolutional cores of different dimensions are used to obtain more number of channels in the same dimensions. Then,we construct an attention mechanism based on red channels to enhance the extraction of features for red channels that tend to lose information in images. Finally,we carry out ablation experiments in the EUVP, UFO120 dataset to demonstrate the effectiveness of the red channel attention mechanism. By analyzing the various indicators of the contrast experiment enhancement results,we prove that the enhancement results have higher structural similarity and peak signal-to-noise ratio,and have higher color balance,clarity and contrast in terms of reference-free indicators,and its comprehensive performance is better than the previous methods.
[1] LI C Y,GUO J C,GUO C L.Emerging from water:underwater image color correction based on weaklysupervised color transfer[J].IEEE Signal ProcessingLetters,2018,25(3):323-327.
[2] SKINNER K A,ZHANG J,OLSON E A,et al.UWStereoNet:unsupervised learning for depthestimation and color correction of underwater stereoimagery[C]//Proceedings of the InternationalConference on Robotics and Automation.Montreal:IEEE,2019.
[3] FU X Y,CAO X Y.Underwater image enhancementwith global-local networks and compressed-histogramequalization[J].Signal Processing:ImageCommunication,2020,86:115892.
[4] SCHETTINI R,CORCHS S.Underwater imageprocessing:state of the art of restoration and imageenhancement methods[J].EURASIP Journal onAdvances in Signal Processing,2010:1-14.
[6] SCHECHNER Y,KARPEL N.Recovery of underwatervisibility and structure by polarization analysis[J].IEEE Journal of Oceanic Engineering,2005,30(3):570-587.
[7] TREIBITZ T,SCHECHNER Y.Turbid sceneenhancement using multi-directional illuminationfusion[J].IEEE Transactions on Image Processing,2012,21(11):4662-4667.
[8] IQBAL K,ODETAYO M,JAMES A,et al.Enhancingthe low quality images using unsupervised colourcorrection method[C]//2010 IEEE InternationalConference on Systems,Man and Cybernetics.Istanbul:IEEE,2010.
[9] GHANI A S A,ISA N A M.Underwater image qualityenhancement through integrated color model withRayleigh distribution[J].Applied Soft Computing,2015,27:219–230.
[10] ANCUTI C,ANCUTI C O,HABER T,et al.Enhancingunderwater images and videos by fusion[C]//2012IEEE Conference on Computer Vision and PatternRecognition.New York:IEEE,2012.
[11] ANCUTI C O,ANCUTI C,VLEESCHOUWER C D,et al.Color balance and fusion for underwater imageenhancement[J].IEEE Transactions on ImageProcessing,2018,27(1):379–393.
[12] ANCUTI C O,ANCUTI C,VLEESCHOUWER C,et al.Color channel compensation(3C):a fundamentalpre-processing step for image enhancement[J].IEEETransactions on Image Processing,2019,29:2653–2665.
[13] WANG Z D,CUN X D,BAO J M,et al.UFORMER:a general U-shaped transformer for image restoration[C]//Proceedings of the IEEE/CVF Conference on ComputerVision and Pattern Recognition.New York:IEEE,2022.
[14] TU Z Z,TALEBI H,ZHANG H,et al.MAXIM:multi-axis MLP for image processing[C]//Proceedingsof the IEEE/CVF Conference on Computer Vision andPattern Recognition.New York:IEEE,2022.
[15] ZHANG R R,QIU H,WANG T,et al.MONODETR:depth-aware transformer for monocular 3D objectdetection[J].arXiv Preprint arXiv,2022:2203.13310.
[16] GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al.Generative adversarial networks[J].Communicationsof the ACM,2020,63(11):139–144.
[17] LI C Y,GUO J C,GUO C L.Emerging from water:underwater image color correction based on weaklysupervised color transfer[J].IEEE Signal ProcessingLetters,2018,25(3):323–327.
[18] LI C Y,ANWAR S,PORIKLI F.Underwater sceneprior inspired deep underwater image and videoenhancement[J].Pattern Recognition,2020,98:107038.
[19] LI C Y,GUO C L,REN W Q,et al.An underwaterimage enhancement benchmark dataset and beyond[J].IEEE Transactions on Image Processing,2019,29:4376–4389.
[20] JAMADANDI A,MUDENAGUDI U.Exemplar-basedunderwater image enhancement augmented by waveletcorrected transforms[C]//Proceedings of the IEEE/CVFConference on Computer Vision and Pattern RecognitionWorkshops.New York:IEEE,2019.
[21] YANG M,HU K,DU Y X,et al.Underwater imageenhancement based on conditional generativeadversarial network[J].Signal Processing:ImageCommunication,2020,81:115723.
[22] ANCUTI C,ANCUTI C O,HABER T,et al.Enhancingunderwater images and videos by fusion[C]//2012IEEE Conference on Computer Vision and PatternRecognition.New York:IEEE,2012.
[23] HE K M,SUN J,TANG X O.Single image hazeremoval using dark channel prior[J].IEEE Transactionson Pattern Analysis and Machine Intelligence,2010,33(12):2341–2353.
[24] PENG Y T,COSMAN P C.Underwater imagerestoration based on image blurriness and lightabsorption[J].IEEE Transactions on Image Processing,2017,26(4):1579–1594.
[25] LI C Y,GUO C L,REN W Q,et al.An underwaterimage enhancement benchmark dataset and beyond[J].IEEE Transactions on Image Processing,2019,29:4376–4389.
[26] FABBRI C,ISLAM M J,SATTAR J.Enhancingunderwater imagery using generative adversarialnetworks[C]//2018 IEEE International Conference onRobotics and Automation(ICRA).New York:IEEE,2018.