David's Astronomy Pages
Notes - Session 1201 (2024-03-27)

 
Bullet Session Aims & Highlights
 - Observing Result
 - Night Summary Plot
 - Session Event Log
Bullet Operational Issues
  - Critical Issues (0),  Major Issues (1),  Minor Issues (4),  Small Defects (4),  Continuous Improvement (4)
Bullet Images from 2024-03-27 >>         
   
Bullet Investigation - CCD Monitor lowered Camera SetPoint Temperature to an unachievable level
   
Bullet Investigation - TheSky6 failing to Image Link and to Update Telescope Coordinates during slewing (over 50 min period)
   
Bullet Current/Latest Session >>
   

Session Aims & Highlights (2024-03-27)

Main aims

  1. Targets.  Acquire images of a selection of variable stars, nearby stars, comets & deep sky targets as allowed by sky conditions.
     ( 12P/Pons-Brooks is now an early evening object only and its was not a feasiblea im for the session due to expected early cloud)
  2. AstroMain. Test new 3.67 version  of AstroMain in a live session, following mutliple changes & improvements in version 3.66.7 & 3,37. Verify there are no significant side-effects or issues with the new versions Acquire images of Comet 12P/Pons-Brooks which has been undergoing regular outbursts.

 Equipment & Software

Highlights

Notes:

 

Summary Plots & Logs

Observing Plan
Image
  
Observing Result
Image
   
Image
 
Dome & Scope Slewing Performance
Image
  
Slew/Centering Performance
Image
  
Guiding Performance
Image
  
Sky Conditions (Locate Frames)
Image 
  
Night Sky Summary Plot
Top axis: Sky Brightness at Zenith (in ADU/s)
Lefthand axis: Local Time (hh LT). Righthand axis: Sun Altitude (degs)
Image   
  
Actual Weather vs Pre-Session Weather Forecast
Image
Image
  
Session Event Log
Time     Event Detail
22:33:43 Session Monitoring AutoStart monitoring for Live Session opportunity between 22:33 & 03:40
22:33:44 Session AutoStarting Session autostarting (22:33)
22:33:55   CCDSoft Restarting CCDSoft being restarted (to set AutoSave No.)
22:34:20   Camera1 Connected SBIG Camera connected (Set point -20°C)
22:34:22 Session Created Session Created (Live, 2024-03-27 S01201, ImageSaveNum: 1201001)
22:34:26   Scope Switched On Telescope Power has been switched on via UPB Powerbox.
22:35:20   CcdCamera Frozen CcdCamera appears to be frozen at around 22:35 in section 'GetCameraProperties'
22:35:56   CCDSoft Restarting CCDSoft being restarted (attempt to fix frozen CcdCamera)
22:36:04   SBIG Camera Reset SBIG Camera being power-cycled
22:36:12   Services Started Observatory Services started
22:36:19 Observatory (Auto) Observatory placed in Fully-Automated Mode
22:36:22 Session Pending Session pending (2024-03-27)
22:36:24 Session Initiating Session initiating (2024-03-27)
22:36:55   Camera1 Connected SBIG Camera connected (Set point -15°C)
22:36:58   Plan Requested Observing Plan requested from AstroPlan (1.39.14)
22:38:00   Plan Loaded Observing Plan loaded to queue (Plan ID: 976)
22:38:40   Telescope Connected Telescope connected (TheSky6)
22:39:04 Session Equilibration Session ready to Open Dome
22:39:49   Dome Opened Dome opened (Opening time 45s, Zigbee 40s)
22:39:59 Session Running Session running
22:40:01   Queue Started Observing Queue started (17 targets selected)
22:40:05     Target Started (NrZen) Target started (Focus Field 9, HIP 44139)
22:40:19       Dome Unparked Dome unparked
22:44:54       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
22:47:30       Focusing Completed Foc1 AutoFocus Completed (Profile No 1, wide)
22:49:28       Focusing Completed Foc1 AutoFocus Completed (Profile No 1)
22:49:31       Focusing Started-Foc2 Foc2 Focusing Started (Secondary Scope, using ShCap)
22:51:39       Focusing Completed Foc2 AutoFocus Completed (Profile No 2, wide)
22:53:21       Focusing Completed Foc2 AutoFocus Completed (Profile No 2)
22:53:38     Target Completed (NrZen) Target completed (Focus Field 9, HIP 44139)
22:53:43     Target Started (1/17) Target started (1/17, AT2023tsk)
23:03:08       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
23:05:18       Focusing Completed Foc1 AutoFocus Completed (Profile No 3)
23:18:27     Target Completed Target partially completed (1/17, AT2023tsk)
23:18:31     Target Started (2/17) Target started (2/17, NGC 6433 w/SN2024efn)
23:22:01       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
23:24:28       Focusing Completed Foc1 AutoFocus Completed (Profile No 4)
23:40:28     Target Completed Target completed (2/17, NGC 6433 w/SN2024efn)
23:40:32     Target Started (3/17) Target started (3/17, NGC 4192A w/AT2024exw)
23:45:35       Focusing Skipped Foc1 focusing skipped - star is lost (TCF-S)
00:01:50     Target Completed Target completed (3/17, NGC 4192A w/AT2024exw)
00:01:54     Target Started (4/17) Target started (4/17, 62P/Tsuchinshan)
00:04:24       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
00:06:40       Focusing Completed Foc1 AutoFocus Completed (Profile No 5)
00:18:09     Target Completed Target completed (4/17, 62P/Tsuchinshan)
00:18:13     Target Started (5/17) Target started (5/17, NGC 4619 w/SN2024drt)
00:21:13       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
00:23:39       Focusing Completed Foc1 AutoFocus Completed (Profile No 6)
00:40:00     Target Completed Target completed (5/17, NGC 4619 w/SN2024drt)
00:40:04     Target Started (6/17) Target started (6/17, M101 w/SN2023ixf)
00:43:16       Focusing Skipped Foc1 focusing skipped - star is too dim (TCF-S)
00:59:35     Target Completed Target completed (6/17, M101 w/SN2023ixf)
01:02:28     Target Started (7/17) Target started (7/17, UGC 5886 w/SN2024hw)
01:06:08       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
01:08:33       Focusing Completed Foc1 AutoFocus Completed (Profile No 7)
01:24:44     Target Completed Target completed (7/17, UGC 5886 w/SN2024hw)
01:24:48     Target Started (8/17) Target started (8/17, NGC 3443 w/SN2024ehs)
01:27:30       Focusing Skipped Foc1 focusing skipped - star is too dim (TCF-S)
01:43:28     Target Completed Target completed (8/17, NGC 3443 w/SN2024ehs)
01:47:08     Target Started (9/17) Target started (9/17, GCVS BL Lac)
01:51:03       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
01:53:15       Focusing Completed Foc1 AutoFocus Completed (Profile No 8)
01:57:07     Target Completed Target completed (9/17, GCVS BL Lac)
01:57:26     Target Started (10/17) Target started (10/17, AT2024dsj (CV))
02:00:24       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
02:02:36       Focusing Completed Foc1 AutoFocus Completed (Profile No 9)
02:04:32       SoftSuspend Called Soft Suspend called due to Deteriorating Conditions (too few stars)
02:08:18       SoftSuspend Cancelled Soft Suspend is cancelled due to improved conditions
02:08:25     Target Completed Target completed (10/17, AT2024dsj (CV))
02:09:46     Target Started (11/17) Target started (11/17, NGC 3690 w/SN2023wrk)
02:21:52   CCDSoft Restarting CCDSoft being restarted (attempt to fix locked thread)
02:21:59   SBIG Camera Reset SBIG Camera being power-cycled
02:22:50   Camera1 Connected SBIG Camera connected (Set point -20°C)
02:22:52     Target Failed (11/17) Target failed due to exception (11/17, NGC 3690 w/SN2023wrk)
02:32:06     Target Started (12/17) Target started (12/17, NGC 4216 w/SN2024gy)
02:45:34   CCDSoft Restarting CCDSoft being restarted (attempt to fix locked thread)
02:45:41   SBIG Camera Reset SBIG Camera being power-cycled
02:46:32   Camera1 Connected SBIG Camera connected (Set point -20°C)
02:46:34     Target Failed (12/17) Target failed due to exception (12/17, NGC 4216 w/SN2024gy)
02:54:26     Target Started (13/17) Target started (13/17, NGC 3206 w/SN2024bch)
03:19:31     Target Completed Target completed (13/17, NGC 3206 w/SN2024bch)
03:19:35     Target Started (14/17) Target started (14/17, WDS GRB 34)
03:23:30       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
03:25:28       Focusing Completed Foc1 AutoFocus Completed (Profile No 10)
03:27:46     Target Completed Target completed (14/17, WDS GRB 34)
03:27:50     Target Started (15/17) Target started (15/17, CGCG 217-021 w/AT2023clc)
03:31:08       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
03:33:07       Focusing Completed Foc1 AutoFocus Completed (Profile No 11)
03:49:09     Target Completed Target completed (15/17, CGCG 217-021 w/AT2023clc)
03:49:13     Target Started (16/17) Target started (16/17, UGC 8630 w/SN2024drv)
03:52:05       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
03:54:33       Focusing Completed Foc1 AutoFocus Completed (Profile No 12)
04:10:19     Target Completed Target completed (16/17, UGC 8630 w/SN2024drv)
04:10:23     Target Started (17/17) Target started (17/17, GCVS R CrB)
04:13:03       Focusing Started-Foc1 Foc1 Focusing Started (TCF-S)
04:14:47       Focusing Completed Foc1 AutoFocus Completed (Profile No 13)
04:18:00     Target Completed Target completed (17/17, GCVS R CrB)
04:18:03   Queue Completed Job Queue completed
04:18:07 Session Closing Session closing
04:19:02   Dome Closed Dome closed (Closing time 50s, Zigbee 43s)
04:20:00   Dome Parked Dome parked (parking time 51s), Az: 90.0 deg
04:21:10   Telescope Parked Telescope parked (parking time 66s total)
04:21:25   Telescope State Handbox reads 'Scope parked Turn scope off.'
04:21:47   Telescope Switched Off Telescope Power has been switched off via UPB Switch.
04:23:08   Dome Charging Dome is parked and re-charging Ok (19mA)
04:23:10   Services Stopped Night Services stopped
04:23:13 Session Finishing Session Finishing started (Create Fits Summary, Transfer Files)
04:23:30     Dome (Find Park) Find Park started (Search Az 87.0 to 93.0°, Step 0.2°, Narrow)
04:24:58     Dome Find Park found (Best Park Az 90.6°)
04:25:04     Dome Dome has been synced at park position (Az 90.0°, Adjustment: -0.6°)
04:25:06   Dome Parked Dome parked
04:25:23   Dome Charging Dome is parked and re-charging Ok (18mA)
04:25:25 Session Finished Session Finished

 
Session Alerts & Alarms
Time     Type       Name Detail
22:35:56 Red Alert CcdCamera CcdCamera appears to be frozen (last cycle at 22:35:20) in section 'GetCameraProperties'
22:36:01 Green Clear CcdCamera CcdCamera has resumed again (22:36) after 42s
22:36:20 Yellow Alert Disk Space Free Space on C:\ Drive (44.36 GB) is less than 50 GB
04:23:27 Yellow Alert Disk Space Free Space on C:\ Drive (43.00 GB) is less than 50 GB
04:25:23 Green Clear Dome Charging Dome is parked and re-charging Ok (18mA)
 

Back to Top


Operational Issues (2024-03-27 S1201)

[ Prev | Next ]

Critical Issues

Major Issues

Minor Issues

Small Defects

Continuous Improvement

[ Prev | Next ]

Back to Top


Investigation - CCD Monitor lowered Camera SetPoint Temperature to an unachievable level

Issue

1) Job Execution had to wait a long time for CCD Camera Cooling to stablise & timed out after 5 minutes (22:55)

2) An inappropriate set point temperature of -25°C was set (one that camera cooling couldn't reach given the ambient temperature)

Description

WIth CCD Camera initially connected with a set point temperature of -15°C, ( vs Ambient Temperature of 6°C) and then moved to -20°C , whilst waiting for CCD Temperature to stabilise ahead of Centering Target 1/17 (AT2023tsk), CCDTemp monitor announched that CCD Temperature would be lowered to -25°C. 

The camera didn't seem to make any progress below -22°C  and as -25°C didn't look to be achievable temperature as that would be 31°C below ambient it was decided by user to update the Set Point Temperature back to -20°C (this was after 'Propose' temperature utility suggested only -15°C) .

Even though CCD Temperature dropped back to -20°C and seemed to be stabilised at this temperature the job executor continued to wait until the loop timed out after 5 mins.

Other cases with confusing CCD Temperature decisions have been seen in 2 or 3 other sessions. 

Analysis

  22:53:30   Check   CCD Cooler          Alert   | Av. Cooler Power (59.3%) is below Lower Threshold (60%)
  22:53:39   Change  CCDSetPoint         Info    | CCD Temperature SetPoint has been lowered to -20.0 degC (22:53)
  22:53:39   WaitOn  Camera.CCD Cooler   Info    | Wait for CCD Temperature Stabilisation is deferred until start of the next CCD image

  22:55:12   WaitOn  Camera.CCD Cooler   Info    | Waiting for CCD Temperature (-19.1) to stabilise at new set point (-20.0°C)
  22:55:12.  Change  CCDSetPoint         Info    | CCD Temperature SetPoint has been lowered to -25.0 degC (22:55)
  22:55:21   Check   CCD SetPoint        Info    | CCD Temperature Set Point has changed to -25.0 degC

  22:57:08   Request Cam1.SetPointChange Info    | User request to update Camera1 SetPoint Temperature
  22:57:21   Check   CCD SetPoint        Info    | CCD Temperature Set Point has changed to -20.0 degC

  22:38:54 7.6 -13.1  100    Set Point -15
  22:40:54 7.5 -16.5   60    "
  22:42:54 7.4 -15.2   59    "
  22:44:54 7.5 -15.2   61    "
  22:46:54 7.4 -15.2   60    "
  22:48:54 7.4 -14.8   58    "
  22:50:54 7.3 -14.8   60    "
  22:52:54 7.3 -14.8   58    "
  22:53:39                   Set Point -20
  22:54:54 7.3 -18.7  100    "
  22:55:12                   Set Point -25
  22:56:54 7.2 -21.3  100    "
  22:57:21                   Set Point -20
  22:58:54 7.2 -20.4   69    "
  23:00:54 7.1 -20.0   76    "
  23:02:54 7.0 -20.0   76    "
  23:04:54 7.0 -20.0   76    "
  23:06:54 6.9 -20.0   75    "

 

Conclusion

Actions:

Back to Top


Investigation - TheSky6 failing to Image Link and failing to Update Telescope Coordinates during slewing (over 50 min period)

Issue

  1. Operations including Image linking and Slew Monitoring ran very slowly and in case of image linking failed during a 50 min period (02:11 to 03:02)
     
  2. ObsOverseer mistook slow Job Execution as being a frozen Job Queue and ordered a CCDSoft/SBIG Camera restart (02:21 & 02:45 )
     
  3.  Two consecutive targets failed with 'RPC Server is unavailable' exceptions following issues during Locate Frame Linking / CCDSoft Restart (02:22 & 02:45).

The issues resulted in 2 out 17 planning targets failing (fortunately the issue resolved itself)

Description

Around the time that two consecutive targets 11/17 (NGC 3690 w/SN2023wrk) and 12/17 (NGC 4216 w/SN2024gy) failed with "RPC server is unavailable" exceptions a number of strange things were happening , with Image linking running very slowly & failing and Slew Monitoring having 7-15s gaps in both scope & dome positions.

The following timeline describes the key events during this time.  The problem period seems to begin around 02:11 during Target 11/17 and last until 03:02 during Target 13/17.

 02:09:51  Slew to Target 11/17 (NGC 3690) started. Slew reporting was normal
 02:11:17  Imaging linking of Locate Frame 1 (#1201074) took a very long time (546s total) and failed without finding a match. 
           (during later linking of the Reduced Image, image linking took just 4s !) .
 02:21:52  ObsOverseer judged that the Job Queue was frozen and ordered a CCDSoft/SBIG Camera Restart in
           an 'attempt to fix locked thread'
           (this was an incorrect assessment, the job queue was in fact just running but very slowly)
 02:22:19  'RPC server is unavailable' exception
 02:22:50  Target Failed
 
 02:33:05  Slew to Target 12/17 (NGC 4216) started
 02:33:12  Reporting of Scope Path & Listing of Dome Path 'held up' for 10s interval
 02:33:22  Reporting of Scope Path & Listing of Dome Path 'held up' for 15s interval
 02:34:03  Imaging linking of Locate Frame 1 (#1201075) failed due to too few stars 
 02:35:01  Imaging linking of Locate Frame 2 (#1201076) took a very long time (386s total) and failed without finding a match. 
           (during late linking of the Reduced Image, image linking took just 1s !) .
 02:45:34  ObsOverseer judged that the Job Queue was frozen and ordered a CCDSoft/SBIG Camera Restart in
           an 'attempt to fix locked thread'
           (again this was an incorrect assessment, the job queue was in fact just running but very slowly)
 02:45:38  'RPC server is unavailable' exception
 02:46:33   Target Failed

 02:55:23  Slew to Target 13/17 (NGC 3206) started
 02:55:32  Reporting of Scope Path & Listing of Dome Path 'held up' for 7s interval
 02:55:40  Reporting of Scope Path & Listing of Dome Path 'held up' for 15s interval
 02:56:52  Imaging linking of Locate Frame 1 (#1201077) took a long time (288s total) but did eventually succeed
           (during late linking of the Reduced Image, image linking took just 1s !) .
 02:35:01  Imaging linking of Locate Frame 2 (#1201078) was normal, taking just 3s and find a match. 

           Rest of session normal.....

Analysis

Conclusion

Actions:

Back to Top