Veil Challenge (Lots of Noise)

General discussion about StarTools.
Post Reply
sandconp
Posts: 32
Joined: Tue Dec 03, 2019 6:59 pm

Veil Challenge (Lots of Noise)

Post by sandconp »

I am still learning Star Tools and I think I have a very good image to work on since there are lots of noise problems. I processed the image in PixInsight a few months ago and I did a pretty good job getting rid of the noise but could not bring out the colors as much as I would like. I spent a lot of time in PI working on this image and I hope that Star Tools can make it an easier process and save time.

So I was wondering if somebody could process my Veil Image and document the steps you did to improve my image? I did not have a cooled camera at the time and I did not take any dark frames plus it was in the summer months.

Here is the link to my FITS File. The image has already been stacked using Sharpcap Pro with Live Stacking.

https://www.dropbox.com/s/8f7snw54d4h2g ... .fits?dl=0
almcl
Posts: 265
Joined: Wed Jan 21, 2015 7:15 pm
Location: Shropshire. UK

Re: Veil Challenge (Lots of Noise)

Post by almcl »

Here's a very quick run through (non-expert disclaimer). I haven't managed to deal with the walking noise (dithering between subs might help with this) and the background has come out too dark, although with care I am sure this could be corrected.

See what you think?
Stack_16bits_18frames_180s.jpg
Stack_16bits_18frames_180s.jpg (86.83 KiB) Viewed 6164 times
Skywatcher 190MN, ASI 2600 or astro modded Canon 700d, guided by OAG, ASI120, PHD2
sandconp
Posts: 32
Joined: Tue Dec 03, 2019 6:59 pm

Re: Veil Challenge (Lots of Noise)

Post by sandconp »

That certainly got rid of the noise. Can I ask you the steps you performed to fix this? I noticed that there are a lot less starts too.
almcl
Posts: 265
Joined: Wed Jan 21, 2015 7:15 pm
Location: Shropshire. UK

Re: Veil Challenge (Lots of Noise)

Post by almcl »

Here's the relevant bits of the logfile.

The stars mostly disappear at the second use of the life module although I did use shrink right at the end as they looked a bit large.

----------------------------------------------------------
StarTools 1.6.382alpha
Wed Dec 11 18:39:08 2019
-----------------------------------------------------------
File loaded [,,,,\Stack_16bits_18frames_180s.fits].
Image size is 3096 x 1560
---
Type of Data: Linear and was Bayered, but not whitebalanced

--- Auto Develop
(default parameters)

--- Crop
Parameter [X1] set to [28 pixels]
Parameter [Y1] set to [58 pixels]
Parameter [X2] set to [3059 pixels (-37)]
Parameter [Y2] set to [1514 pixels (-46)]
Image size is 3031 x 1456

--- Bin
Parameter [Scale] set to [(scale/noise reduction 50.00%)/(400.00%)/(+2.00 bits)]
Image size is 1515 x 728

--- Wipe
Defaults but:
Parameter [Dark Anomaly Filter] set to [7 pixels]


--- Develop

Parameter [Digital Development] set to [94.49 %]

Parameter [Dark Anomaly Filter] set to [8.0 pixels]

Mask used (BASE64 PNG encoded) (select the nebulosity)
--- Life
Parameter [Detail Preservation] set to [Linear Brightness Mask]
Parameter [Compositing Algorithm] set to [Multiply, Gamma Correct]
Parameter [Inherit Brightness, Color] set to [Brightness]
Parameter [Output Glow Only] set to [No]
Parameter [Airy Disk Sampling] set to [128 x 128 pixels]
Parameter [Airy Disk Radius] set to [64 pixels]
Parameter [Glow Threshold] set to [0 %]
Parameter [Detail Preservation Radius] set to [20.0 pixels]
Parameter [Saturation] set to [100 %]
Parameter [Strength] set to [72 %]
Parameter [Mask Fuzz] set to [40.0 pixels]
Mask used (BASE64 PNG encoded)

--- Contrast
Deafults

--- Deconvolution
Parameter [Image Type] set to [Deep Space]
Parameter [Radius] set to [1.5 pixels]
Parameter [Iterations] set to [6]
Parameter [Regularization] set to [1.00 (optimal noise and detail)]
Parameter [Mask Fuzz] set to [4.0 pixels]
Parameter [Enhanced Deringing] set to [Off]

--- Wavelet Sharpen
Parameter [Structure Size] set to [Large]

--- SNR-aware Wavelet Sharpening
Parameter [Scale 1] set to [100 %]
Parameter [Scale 2] set to [100 %]
Parameter [Scale 3] set to [100 %]
Parameter [Scale 4] set to [100 %]
Parameter [Scale 5] set to [100 %]
Parameter [Mask Fuzz] set to [4 pixels]
Parameter [Amount] set to [279 %]
Parameter [High SNR Size Bias] set to [85 %]
Parameter [Low SNR Size Bias] set to [0 %]
Parameter [Dark/Light Enhance] set to [50% / 50%]

Mask used (BASE64 PNG encoded)

--- HDR
defaults for
Parameter [Algorithm] set to [Optimize Soft]

--- Life
Parameter [Detail Preservation] set to [Linear Brightness Mask]
Parameter [Compositing Algorithm] set to [Multiply, Gamma Correct]
Parameter [Inherit Brightness, Color] set to [Brightness]
Parameter [Output Glow Only] set to [No]
Parameter [Airy Disk Sampling] set to [128 x 128 pixels]
Parameter [Airy Disk Radius] set to [4 pixels]
Parameter [Glow Threshold] set to [0 %]
Parameter [Detail Preservation Radius] set to [20.0 pixels]
Parameter [Saturation] set to [100 %]
Parameter [Strength] set to [59 %]
Parameter [Mask Fuzz] set to [1.0 pixels]

--- Color
Deafaults

--- Wavelet De-Noise
Parameter [Filter Type] set to [Distance Weighted Outlier Rejection]
Parameter [Grain Size] set to [8.0 pixels]

--- Wavelet De-Noise
Parameter [Scale 1] set to [95 %]
Parameter [Scale 2] set to [95 %]
Parameter [Scale 3] set to [95 %]
Parameter [Scale 4] set to [95 %]
Parameter [Scale 5] set to [0 %]
Parameter [Mask Fuzz] set to [1.0 pixels]
Parameter [Scale Correlation] set to [6]
Parameter [Color Detail Loss] set to [12 %]
Parameter [Brightness Detail Loss] set to [12 %]
Parameter [Grain Dispersion] set to [8.0 pixels]
Parameter [Non-linear Response <] set to [Off]
Parameter [Smoothness] set to [65 %]

Mask used (BASE64 PNG encoded)
--- Shrink
Parameter [Mode] set to [Tighten]
Parameter [Mask Grow] set to [1 pixels]
Parameter [Iterations] set to [1 pixels]
Mask used (BASE64 PNG encoded)


File saved [...Stack_16bits_18frames_180s.jpg].
Skywatcher 190MN, ASI 2600 or astro modded Canon 700d, guided by OAG, ASI120, PHD2
User avatar
admin
Site Admin
Posts: 3382
Joined: Thu Dec 02, 2010 10:51 pm
Location: Melbourne
Contact:

Re: Veil Challenge (Lots of Noise)

Post by admin »

My two cents, processed in StarTools 1.6.383 alpha;
Stack_16bits_18frames_180s(2).jpg
Stack_16bits_18frames_180s(2).jpg (275.02 KiB) Viewed 6152 times
This dataset is definitely let down by the lack of calibration frames and dithering. They are not optional, specially if you're going for fainter objects like these!


File loaded [/home/ivojager/Downloads/Stack_16bits_18frames_180s(2).fits].
--- Auto Develop
To see what we got. Heavy walking noise, poor/no calibration. Dataset appears to have been processed already (DBE/ABE?).
--- Bin
To reduce noise and make use of oversampling.
--- Crop
Parameter [X1] set to [7 pixels]
Parameter [Y1] set to [25 pixels]
Parameter [X2] set to [1528 pixels (-20)]
Parameter [Y2] set to [757 pixels (-23)]
--- Wipe
Remove remnant vignetting/gradient. Vignetting preset with tweaks;
Parameter [Dark Anomaly Filter] set to [3 pixels]
Parameter [Corner Aggressiveness] set to [97 %]
--- Rotate
Parameter [Angle] set to [180.00]
--- Auto Develop
RoI over a good sample of the nebulosity.
Parameter [RoI X1] set to [784 pixels]
Parameter [RoI Y1] set to [37 pixels]
Parameter [RoI X2] set to [1252 pixels (-269)]
Parameter [RoI Y2] set to [205 pixels (-527)]
--- Deconvolution
Auto-generate mask
Parameter [Radius] set to [1.7 pixels]
--- Life
Isolate preset (full mask set!).
This pushes back busy star fields and background noise.
--- Color
Legacy preset.
Parameter [Dark Saturation] set to [2.50]
Parameter [Bright Saturation] set to [2.50]
Parameter [Saturation Amount] set to [250 %]
Parameter [Blue Bias Reduce] set to [1.35]
Parameter [Green Bias Reduce] set to [1.10]
Parameter [Red Bias Reduce] set to [1.33]
--- Psycho-Visual Grain Equalization De-Noise
Switching Tracking off, Denoise 2.
Parameter [Grain Removal] set to [60 %]
Parameter [Grain Limit Detail] set to [7.6 pixels]
Parameter [Grain Limit Color] set to [7.6 pixels]

Note in general, StarTools has trouble with any sort of noise that is correlated (e.g. anything that has structure to it and is not the result of shot noise). Walking noise is an good example of correlated noise.

Hope this helps!
Ivo Jager
StarTools creator and astronomy enthusiast
sandconp
Posts: 32
Joined: Tue Dec 03, 2019 6:59 pm

Re: Veil Challenge (Lots of Noise)

Post by sandconp »

Ivo,

I realize that this is not the best image to use. I have since gotten much better and I now apply the darks during live stacking with Sharpcap Pro.

Do you have some kind of documentation that would document the general work flow to process an image in Star Tools? I watched a very good video on You Tube with someone using Star Tools on the Rosette Nebula.

Thanks !
User avatar
admin
Site Admin
Posts: 3382
Joined: Thu Dec 02, 2010 10:51 pm
Location: Melbourne
Contact:

Re: Veil Challenge (Lots of Noise)

Post by admin »

sandconp wrote:Ivo,

I realize that this is not the best image to use. I have since gotten much better and I now apply the darks during live stacking with Sharpcap Pro.

Do you have some kind of documentation that would document the general work flow to process an image in Star Tools? I watched a very good video on You Tube with someone using Star Tools on the Rosette Nebula.

Thanks !
No problem!
With regards to workflows, you will notice they all - as of 1.5 even for complex composites! - follow a very similar flow. As for workflow tutorials, have a look at the Links & tutorials section on the website. Any trouble, let us know!
Ivo Jager
StarTools creator and astronomy enthusiast
sandconp
Posts: 32
Joined: Tue Dec 03, 2019 6:59 pm

Re: Veil Challenge (Lots of Noise)

Post by sandconp »

admin wrote:
sandconp wrote:Ivo,

I realize that this is not the best image to use. I have since gotten much better and I now apply the darks during live stacking with Sharpcap Pro.

Do you have some kind of documentation that would document the general work flow to process an image in Star Tools? I watched a very good video on You Tube with someone using Star Tools on the Rosette Nebula.

Thanks !
No problem!
With regards to workflows, you will notice they all - as of 1.5 even for complex composites! - follow a very similar flow. As for workflow tutorials, have a look at the Links & tutorials section on the website. Any trouble, let us know!

Ivo,

Thank You for taking a look at my Veil Image. I know it’s not a good image to start with but I wanted to see what Star Tools could do with a badly taken image. I have learned a lot since then on taking good images. Also thanks for the Tutorial Links it was very helpful to understand the general flow of Star Tools.

Conrad
Post Reply