Author Topic: Dual ISO - massive dynamic range improvement (dual_iso.mo)  (Read 1672365 times)

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2575 on: August 18, 2015, 12:08:54 AM »
Just as a reminder--if you are testing out cr2hdr, raw2dng and mlv_dump from dmilligan's ml_dng branch please make sure you post your comments to the open pull request:

https://bitbucket.org/hudson/magic-lantern/pull-requests/603/dng-module-wip

Once again, here are the Windows and Mac versions.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2576 on: August 18, 2015, 12:13:44 AM »
Cr2hdr.exe works now. Tag-Issue solved.
But Win 8.1 "Smartscreen" is warning me about security threat. Never happened before.

You shouldn't be downloading .exe files from strangers. Who knows what they might do to your computer.

Just kidding--I'm surprised you haven't gotten more security threat warnings.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

toze3

  • New to the forum
  • *
  • Posts: 13
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2577 on: August 18, 2015, 11:11:02 AM »
Thanks. Here's the whole bunch, cr2hdr, raw2dng and mlv_dump.

These are working on my old Windows laptop and they should also work on a new 64-bit system. (Used mingw-w64-i686)


Already tested and it's ok, except it's not the latest 20-bit version, but cr2hdr 16-bit and the camera white balance isn't correct, maybe because it doesn't have the option  --wb=graymax

See the following picture, in the left is the cr2hdr 20 bit version, with tag corrected and in the right the DNG from this cr2hdr version

RAWTHERAPEE 4.2.276 with no processing with white balance set to camera. When in AUTO mode both looks equal



Also from the logs:
This new cr2hdr 16-bit
Code: [Select]
Last update: 76b5a32 on 2015-03-21 15:19:29 UTC by david:
dng: allow 64 bit compilation for raw2dng, mlv_dump, and cr2hdr

Unknown option: --wb=graymax
Active options:
--amaze-edge    : use a temporary demosaic step (AMaZE) followed by edge-directed interpolation (default)
--cs2x2         : apply 2x2 chroma smoothing in noisy and aliased areas (default)

Input file      : D:\Fotografia\RAW\0DISO_CR2_BKP\_MG_2498.CR2
Camera          : Canon EOS 550D
Full size       : 5344 x 3516
Active area     : 5202 x 3465
White level     : 12500
Black borders   : 142 left, 51 top
Black level     : 1965
ISO pattern     : dBBd GBRG
Noise levels    : 5.75 10.23 10.34 5.75 (14-bit)
ISO difference  : 3.03 EV (817)
Black delta     : 5.14
Dynamic range   : 10.84 (+) 9.99 => 13.02 EV (in theory)
Looking for hot/cold pixels...
Hot pixels      : 3
Cold pixels     : 1
AMaZE interpolation ...
Amaze took 5.41 s
Edge-directed interpolation...
Semi-overexposed: 40.16%
Deep shadows    : 4.08%
Horizontal stripe fix...
Full-res reconstruction...
ISO overlap     : 4.8 EV (approx)
Half-res blending...
Chroma smoothing...
Building alias map...
Filtering alias map...
Smoothing alias map...
Final blending...
Noise level     : 4.39 (16-bit), ideally 4.36
Dynamic range   : 13.23 EV (cooked)
Black adjust    : -2
White balance determined from WB_RGGBLevelsMeasured
AsShotNeutral   : 0.453714 1 0.809524

CR2HDR 20-bit
Code: [Select]
Last update: 0c08758 on 2015-05-09 19:25:05 UTC by a1ex:
cr2hdr: Makefile commands to create a zip package for Windows

Active options:
--amaze-edge    : use a temporary demosaic step (AMaZE) followed by edge-directed interpolation (default)
--cs2x2         : apply 2x2 chroma smoothing in noisy and aliased areas (default)
--wb=graymax    : set AsShotNeutral by maximizing the number of gray pixels (default)

Input file      : D:\Fotografia\RAW\0DISO_CR2_BKP\_MG_2498.CR2
Camera          : Canon EOS 550D
Full size       : 5344 x 3516
Active area     : 5202 x 3465
Black borders   : 142 left, 51 top
Black level     : 2048
ISO pattern     : dBBd GBRG
White levels    : 11738 12099
Noise levels    : 5.74 10.23 10.34 5.79 (14-bit)
ISO difference  : 3.03 EV (815)
Black delta     : 2.87
Black adjust    : 2
Dynamic range   : 10.72 (+) 9.92 => 12.95 EV (in theory)
Looking for hot/cold pixels...
Hot pixels      : 2
Cold pixels     : 13620
AMaZE interpolation ...
Amaze took 2.23 s
Edge-directed interpolation...
Semi-overexposed: 43.64%
Deep shadows    : 4.95%
Horizontal stripe fix...
49: offset too large (-4315)
50: offset too large (41078)
Full-res reconstruction...
ISO overlap     : 4.7 EV (approx)
Half-res blending...
Chroma smoothing...
Building alias map...
Filtering alias map...
Smoothing alias map...
Final blending...
Noise level     : 66.08 (20-bit), ideally 65.99
Dynamic range   : 13.20 EV (cooked)
Black adjust    : -30
AsShotNeutral   : 0.51 1 0.57, 4557K/g=0.98 (gray max)

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2578 on: August 18, 2015, 05:13:08 PM »
Good report toze3. Looks like dmilligan worked on this before the 20-bit version of cr2hdr was ready.

Please keep checking the comments and changes on the pull request and let me know if you need another build to test.

https://bitbucket.org/hudson/magic-lantern/pull-requests/603/dng-module-wip
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2579 on: August 19, 2015, 03:54:55 AM »
Already tested and it's ok, except it's not the latest 20-bit version

dmilligan just merged his code with the 20-bit version. I'm not able to open the Windows executable on my old laptop but for anyone who wants to do some testing--

Windows cr2hdr-20bit      Macintosh cr2hdr-20bit
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

toze3

  • New to the forum
  • *
  • Posts: 13
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2580 on: August 19, 2015, 11:29:42 AM »
dmilligan just merged his code with the 20-bit version. I'm not able to open the Windows executable on my old laptop but for anyone who wants to do some testing--

Windows cr2hdr-20bit      Macintosh cr2hdr-20bit

It's a 16-bit app not compatible with my 64-bits machine...

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6698
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2581 on: August 19, 2015, 12:45:55 PM »
Mac version cr2hdr works perfectly.
When it comes to white balance and mlv_dump I can see calculations for this in dng folder but numbers in actual dng files are always way off. Might send in a bug report if this issuposed to work same as in mlvfs?

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2582 on: August 19, 2015, 05:38:47 PM »
It's a 16-bit app not compatible with my 64-bits machine...

That's odd, I'll look into it. The Mac version seems to be working.

Anyone else able to compile cr2hdr for Windows willing to help out?
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2583 on: August 20, 2015, 01:44:43 AM »
I've been struggling to get a Windows binary of cr2hdr 20-bit version with the ml_dng changes applied. I do have a version built in the Cygwin environment which means you will need to download the .dll files for it to work. If anyone is interested in trying it out--here is the link.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

toze3

  • New to the forum
  • *
  • Posts: 13
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2584 on: August 20, 2015, 10:19:34 AM »
I've been struggling to get a Windows binary of cr2hdr 20-bit version with the ml_dng changes applied. I do have a version built in the Cygwin environment which means you will need to download the .dll files for it to work. If anyone is interested in trying it out--here is the link.

I put the dll on the same paste that cr2hdr, and it gives an error (translated from portuguese -> entering point not found (dynamic library)

One question, why is the file half the size (in KB) compared with the a1ex original 20-bit version (186KB vs 366KB)

It could be missing things?


dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2585 on: August 20, 2015, 07:59:37 PM »
I put the dll on the same paste that cr2hdr, and it gives an error (translated from portuguese -> entering point not found (dynamic library)

That's why I dislike distributions that require dynamically linked libraries. I'm still struggling getting MinGW to compile the 20-bit version.

Portuguese? Are you in Portugal or Brazil or someplace else? I visited Porto and Lisboa. I can speak Spanish but the extent of my Portuguese is "muito obrigado."

One question, why is the file half the size (in KB) compared with the a1ex original 20-bit version (186KB vs 366KB)

It could be missing things?

Sure, it is missing the libraries. Basically the libraries can be either statically or dynamically linked. Static linking includes the libraries in the executable file so the size of the .exe file is bigger than a dynamically linked version. So far I've only been able to compile dmilligan's ml_dng-cr2dng20bit in Cygwin which doesn't allow statically linked libraries.

I've had my best success at compiling ML code on a Mac. I didn't get any errors or warnings when cross compiling a Windows cr2hdr.exe but obviously it isn't working. Too bad, all the other command line tools seemed to cross compile fine.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2586 on: August 20, 2015, 11:48:30 PM »
Good news everyone--

Windows binary cr2hdr 20-bit version from the ml_dng branch is working. At least it launches on my system. Please try it out.

You can get it here.

This is a MinGW cross compile and no .dll's are required.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6698
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2587 on: August 20, 2015, 11:54:06 PM »
You, re tha man!

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3394
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2588 on: August 21, 2015, 06:43:00 AM »
Just tested it on Windows here at work and I can also confirm that it works...

Seriously @dfort you're a pure workhorse and THANK you for finally closing the gap between Windows & Mac!

Great Job, Mate! [emoji108]
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2589 on: August 21, 2015, 04:13:58 PM »
Anyone tested the new cr2hdr 20-bit on the 70D yet?
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6698
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2590 on: August 21, 2015, 06:52:44 PM »
Tested a 70D file and it works!

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3394
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2591 on: August 21, 2015, 07:09:08 PM »
Yuperonies!
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

toze3

  • New to the forum
  • *
  • Posts: 13
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2592 on: August 24, 2015, 04:52:58 PM »
All ok here!!

Thanks

keepersdungeon

  • Member
  • ***
  • Posts: 147
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2593 on: August 24, 2015, 05:43:10 PM »
Yeah seems gd! Thank you

mizantropia

  • New to the forum
  • *
  • Posts: 3
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2594 on: September 24, 2015, 04:15:40 PM »
Im confused.
I downloaded plugin (and exe file later on) and both doesnt work?
Ive got plugin enabled on my Ligthroom6 plugins list, and still no option to process files on 'right click. menu.
I drop CR2 files on exe file, still nothing.

Win 7, 64 bit.

I checked, those files are dual iso.
What am i doing wrong?

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7340
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2595 on: September 24, 2015, 07:20:42 PM »
- Adobe's documentation about LR export plug-in location is just wrong and kichetof relied on that one. If you don't believe, you may download LR SDK 6 and try to run any of its export plug-ins in C:\TEMP.
If you want to have ML plug-in visible in context menu you have to place cr2hdr.lrplug in your Lightroom program folder in subdir Modules.
You can use your "unvisible" LR plug-in by using "Export ...". You have to select ML plug-in from drop-down list and press Export button.
If you have managed to make it visible in context menu you will see there is no user interface to change setting. If you want to change settings you have to use "Export ...".

- I suppose you downloaded your plug-in version from first post in LR plug-in thread. Sidenote: Why did you place your question here and not there? Anyway, this one is outdated and won't support 70D. Look into BIN subfolder and if there is a file CR2HDR20.exe you want to download and use http://www.filedropper.com/lrplugin

-
Photogs and videographers: Assist in proof reading upcoming in-camera help!. Your input is wanted and needed!

Magiclanterner

  • New to the forum
  • *
  • Posts: 13
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2596 on: September 26, 2015, 12:25:26 PM »
Taken ith my EOS M
The Sun Goes Down - ML Dual ISO by jojobernard523, sur Flickr

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7340
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2597 on: October 01, 2015, 06:25:59 AM »
Look at change list for recent builds:

https://builds.magiclantern.fm/jenkins/job/7D.203/218/changes

Changes 11 to 123 (sic!) are about cr2hdr.
Unfortunately there is no job for creating binaries. Eager to test this. Anyone able to compile for OS X and Windows?
Photogs and videographers: Assist in proof reading upcoming in-camera help!. Your input is wanted and needed!

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3394
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2598 on: October 01, 2015, 08:34:23 AM »
Looks so sick! Definitely eager to test this one out.

Boss didn't play too nice w me and my personal 7D is broken (long story short it got soaked on a shoot my fault) and just found another used one online for $450 that includes a 24 pancake along w 2 batteries and a 64GB card.

Smells like good news are coming soon for 7D owners...
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

Audionut

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3608
  • Blunt and to the point
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #2599 on: October 01, 2015, 12:46:45 PM »
It's only the 20bit branch merged into the unified branch.  So nothing new here, a1ex already made a binary available.

The rest is boring dev stuff from dfort, nothing exciting for an end user.  :P  Unless you ever wanted to compile cr2hdr yourself, in which case it probably just got a whole bunch easier.   ;)