{"id":113,"date":"2017-03-11T12:25:49","date_gmt":"2017-03-11T20:25:49","guid":{"rendered":"http:\/\/duncankitchin.org\/?p=113"},"modified":"2017-03-11T12:25:49","modified_gmt":"2017-03-11T20:25:49","slug":"pixinsight-calibration-workflow-part-1-process-overview","status":"publish","type":"post","link":"http:\/\/duncankitchin.org\/?p=113","title":{"rendered":"PixInsight Calibration Workflow Part 1 : Process Overview"},"content":{"rendered":"<p>This is the start of a write-up of my current PixInsight calibration workflow. I&#8217;ve spent quite a bit of time getting to understand how PixInsight calibration works, and this is what I&#8217;ve come up with after much experimentation and helpful insights from several people on the PixInsight forums. This workflow now produces results that are significantly better than I was getting with my previous tools (such as Maxim).<\/p>\n<p>What we&#8217;re trying to do is to integrate sets of bias, dark and flat frames to create, respectively, master bias, dark and flat frames, and then use those master calibration frames to calibrate each of the light frames. Somewhere during that process we also need to calibrate the dark frames with the master bias frame, and calibrate the flat frames with the master bias and master dark frames. There are multiple different ways we can do this, depending on whether the calibration of the calibration frames happens before or after the integration step.<\/p>\n<p>To illustrate these options, consider first what I&#8217;ve labelled as &#8220;Calibration Workflow I&#8221;. This is the simplest workflow, consisting of these steps:<\/p>\n<ol>\n<li>Integrate the bias frames B<sub>i<\/sub> to create the master bias frame B<sub>m<\/sub><\/li>\n<li>Integrate the dark frames D<sub>i<\/sub> to create the master dark frame D<sub>m<\/sub><\/li>\n<li>Integrate the flat frames F<sub>i<\/sub> to create the master flat frame F<sub>m<\/sub><\/li>\n<li>Calibrate each of the light frames L<sub>i<\/sub> with the masters B<sub>m<\/sub>, D<sub>m<\/sub> and F<sub>m<\/sub><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"120\" data-permalink=\"http:\/\/duncankitchin.org\/?attachment_id=120\" data-orig-file=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png?fit=1115%2C693\" data-orig-size=\"1115,693\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Calibration Workflow I\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png?fit=680%2C422\" class=\"aligncenter size-large wp-image-120\" src=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png?resize=680%2C422\" alt=\"\" width=\"680\" height=\"422\" srcset=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png?resize=1024%2C636 1024w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png?resize=300%2C186 300w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png?resize=768%2C477 768w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-I.png?w=1115 1115w\" sizes=\"auto, (max-width: 680px) 100vw, 680px\" \/><\/a>In this case, the calibration of the calibration frames (dark with bias, flat with dark and bias) happens within the single calibration step. That is, we calibrate the darks by subtracting the master bias from the master dark, and we calibrate the master flat by subtracting the master bias and a scaled version of the master dark. The PixInsight calibration tool has checkboxes that allows selection of which of these post-integration calibration steps we want to use.<\/p>\n<p>A more complex version would calibrate each of the frames in the dark and flat frame sets prior to integration. This version I&#8217;ve called &#8220;Calibration Workflow III&#8221; and consists of these steps:<\/p>\n<ol>\n<li>Integrate\u00a0the bias frames B<sub>i<\/sub> to create the master bias frame B<sub>m<\/sub><\/li>\n<li>Calibrate each of the dark frames D<sub>i<\/sub>\u00a0to create a set of calibrated dark frames\u00a0D<sub>c<\/sub><\/li>\n<li>Integrate the calibrated dark frames D<sub>c<\/sub>\u00a0to create a master dark frame D<sub>m<\/sub><\/li>\n<li>Calibrate each of the flat frames\u00a0F<sub>i<\/sub> to create a set of calibrated flat frames\u00a0F<sub>c<\/sub><\/li>\n<li>Integrate the calibrated flat frames F<sub>c<\/sub> \u00a0to create a master flat frame F<sub>m<\/sub><\/li>\n<li>Calibrate each of the light frames\u00a0L<sub>i<\/sub> with the calibration masters\u00a0B<sub>m<\/sub>, D<sub>m<\/sub> and F<sub>m<\/sub><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"119\" data-permalink=\"http:\/\/duncankitchin.org\/?attachment_id=119\" data-orig-file=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png?fit=1115%2C693\" data-orig-size=\"1115,693\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Calibration Workflow III\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png?fit=680%2C422\" class=\"aligncenter size-large wp-image-119\" src=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png?resize=680%2C422\" alt=\"\" width=\"680\" height=\"422\" srcset=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png?resize=1024%2C636 1024w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png?resize=300%2C186 300w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png?resize=768%2C477 768w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-III.png?w=1115 1115w\" sizes=\"auto, (max-width: 680px) 100vw, 680px\" \/><\/a><\/p>\n<p>In this case, we now have 3 calibration processes, but in each case we don&#8217;t need to do any calibration of the master calibration frames because that all gets done prior to integration.<\/p>\n<p>So why would we want the more complex version? If the integration is an unweighted combine, the results are almost identical. However, by calibrating the individual frames, we separate out the component of the dark frames that is due to dark current and the component of the flat frames that is due to photon-dependent effects prior to the integration. By doing that, we can introduce a scaling during the integration process. This will be useful if there is a variation in temperature of the dark frames or a variation in brightness across the set of flat frames (which will generally be the case unless the flats are being captured with a flat box with a very stiffly regulated power supply). In the case that we are using a regulated cooler in the camera, we don&#8217;t need to worry about variation across the set of darks, but we might need to take account of variation within the set of flats. That leads us to an intermediate version that I&#8217;ve labelled &#8220;Calibration Workflow II&#8221;:<\/p>\n<p><a href=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" data-attachment-id=\"118\" data-permalink=\"http:\/\/duncankitchin.org\/?attachment_id=118\" data-orig-file=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png?fit=1115%2C693\" data-orig-size=\"1115,693\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Calibration Workflow II\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png?fit=680%2C422\" class=\"aligncenter size-large wp-image-118\" src=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png?resize=680%2C422\" alt=\"\" width=\"680\" height=\"422\" srcset=\"https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png?resize=1024%2C636 1024w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png?resize=300%2C186 300w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png?resize=768%2C477 768w, https:\/\/i0.wp.com\/duncankitchin.org\/wordpress\/wp-content\/uploads\/2017\/03\/Calibration-Workflow-II.png?w=1115 1115w\" sizes=\"auto, (max-width: 680px) 100vw, 680px\" \/><\/a><\/p>\n<p>This includes the simplification that we don&#8217;t need to calibrate dark frames prior to integration, but we do calibrate flats prior to integration. In this way, the integration of flats (step 4) can scale the flats prior to combining. The steps are now:<\/p>\n<ol>\n<li>Integrate\u00a0the bias frames B<sub>i<\/sub> to create the master bias frame B<sub>m<\/sub><\/li>\n<li>Integrate the dark frames D<sub>i<\/sub>\u00a0to create a master dark frame D<sub>m<\/sub><\/li>\n<li>Calibrate each of the flat frames\u00a0F<sub>i<\/sub> to create a set of calibrated flat frames\u00a0F<sub>c<\/sub><\/li>\n<li>Integrate the calibrated flat frames F<sub>c<\/sub> \u00a0to create a master flat frame F<sub>m<\/sub><\/li>\n<li>Calibrate each of the light frames\u00a0L<sub>i<\/sub> with the calibration masters\u00a0B<sub>m<\/sub>, D<sub>m<\/sub> and F<sub>m<\/sub><\/li>\n<\/ol>\n<p>That&#8217;s the basic outline. I&#8217;ll explain in detail how to carry out these steps with PixInsight in a follow-up post.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is the start of a write-up of my current PixInsight calibration workflow. I&#8217;ve spent quite a bit of time getting to understand how PixInsight calibration works, and this is what I&#8217;ve come up with after much experimentation and helpful insights from several people on the PixInsight forums. This workflow now produces results that are&#8230; <\/p>\n<div class=\"read-more navbutton\"><a href=\"http:\/\/duncankitchin.org\/?p=113\">Read More<i class=\"fa fa-angle-double-right\"><\/i><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"twitterCardType":"summary","cardImageID":0,"cardImage":"","cardTitle":"","cardDesc":"","cardImageAlt":"","cardPlayer":"","cardPlayerWidth":0,"cardPlayerHeight":0,"cardPlayerStream":"","cardPlayerCodec":"","_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[1],"tags":[],"class_list":["post-113","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8hoWa-1P","jetpack-related-posts":[],"_links":{"self":[{"href":"http:\/\/duncankitchin.org\/index.php?rest_route=\/wp\/v2\/posts\/113","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/duncankitchin.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/duncankitchin.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/duncankitchin.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/duncankitchin.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=113"}],"version-history":[{"count":9,"href":"http:\/\/duncankitchin.org\/index.php?rest_route=\/wp\/v2\/posts\/113\/revisions"}],"predecessor-version":[{"id":125,"href":"http:\/\/duncankitchin.org\/index.php?rest_route=\/wp\/v2\/posts\/113\/revisions\/125"}],"wp:attachment":[{"href":"http:\/\/duncankitchin.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=113"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/duncankitchin.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=113"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/duncankitchin.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=113"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}