Hi Aaron,

I think I have a problem: it seems that whatever config I set the photo always takes around 100 seconds between exposures. Exposure time is correct but the camera constantly stay busy for around 100 seconds. Take a look at the log:

<code>
Mar 21 21:03:18 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:03:18 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.72, Dec 44.65
Mar 21 21:03:17 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:44:31.0, phase 0.1%
Mar 21 21:03:17 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:53:55.4
Mar 21 21:03:17 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:03:17 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 85.1s
Mar 21 21:03:06 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:03:06 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.72, Dec 44.65
Mar 21 21:03:06 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:42:52.0, phase 0.1%
Mar 21 21:03:06 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:52:13.3
Mar 21 21:03:06 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:03:06 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 74.0s
Mar 21 21:02:55 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:02:55 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.72, Dec 44.65
Mar 21 21:02:55 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:41:13.0, phase 0.1%
Mar 21 21:02:55 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:50:31.2
Mar 21 21:02:55 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:02:55 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 62.8s
Mar 21 21:02:44 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:02:44 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.71, Dec 44.65
Mar 21 21:02:44 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:39:34.0, phase 0.1%
Mar 21 21:02:44 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:48:49.1
Mar 21 21:02:44 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:02:44 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 51.7s
Mar 21 21:02:33 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:02:33 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.71, Dec 44.65
Mar 21 21:02:33 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:37:55.0, phase 0.1%
Mar 21 21:02:33 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:47:06.9
Mar 21 21:02:33 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:02:33 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 40.6s
Mar 21 21:02:22 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:02:22 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.71, Dec 44.65
Mar 21 21:02:22 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:36:15.8, phase 0.1%
Mar 21 21:02:22 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:45:24.7
Mar 21 21:02:22 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:02:22 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 29.4s
Mar 21 21:02:11 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:02:11 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.70, Dec 44.65
Mar 21 21:02:11 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:34:36.7, phase 0.1%
Mar 21 21:02:11 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:43:42.4
Mar 21 21:02:11 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:02:11 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 18.3s
Mar 21 21:02:00 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:02:00 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.70, Dec 44.65
Mar 21 21:01:59 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:32:57.4, phase 0.1%
Mar 21 21:01:59 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:42:00.0
Mar 21 21:01:59 allsky [INFO] MainProcess allsky._fileUploadWorkerStart() #893: Starting FileUploader process 3
Mar 21 21:01:59 allsky [INFO] MainProcess allsky._startVideoWorker() #830: Starting VideoWorker process 3
Mar 21 21:01:59 allsky [INFO] MainProcess allsky._startImageWorker() #765: Starting ImageWorker process 3
Mar 21 21:01:59 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:01:59 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 6.6s
Mar 21 21:01:58 allsky [INFO] MainProcess allsky.run() #1243: Total time since last exposure 102.6227 s
Mar 21 21:01:57 allsky [INFO] MainProcess libcamera.setCcdExposure() #192: image command: libcamera-still --immediate --nopreview --encoding png --quality 100 --gain 1 --shutter 20000000 --metadata /tmp/tmppgwpi5tu.json --metadata-format json --output /tmp/tmpuu555usk.png
Mar 21 21:01:57 allsky [INFO] MainProcess allsky.shoot() #1795: Taking 20.00000000 s exposure (gain 1)
Mar 21 21:01:57 allsky [WARNING] MainProcess allsky.periodic_tasks() #976: Periodic tasks triggered
Mar 21 21:01:57 allsky [WARNING] FileUploader002 uploader.saferun() #118: Goodbye
Mar 21 21:01:57 allsky [INFO] MainProcess allsky._fileUploadWorkerStop() #939: Stopping FileUploadWorker process
Mar 21 21:01:57 allsky [WARNING] VideoWorker002 video.saferun() #154: Goodbye
Mar 21 21:01:57 allsky [INFO] MainProcess allsky._stopVideoWorker() #866: Stopping VideoWorker process
Mar 21 21:01:57 allsky [WARNING] ImageWorker002 image.saferun() #225: Goodbye
Mar 21 21:01:57 allsky [INFO] ImageWorker002 miscDb.addImage() #171: Adding image /var/www/html/allsky/images/ccd_8b13b96a-4d49-4f70-973a-d45ce2c507e9/20230321/night/21_21/ccd1_20230321_210152.jpg to DB
Mar 21 21:01:57 allsky [INFO] ImageWorker002 image.write_img() #1081: Image compressed in 0.4248 s
Mar 21 21:01:57 allsky [INFO] ImageWorker002 image.processImage() #426: Image processed in 4.5321 s
Mar 21 21:01:56 allsky [INFO] ImageWorker002 image.white_balance_manual_bgr() #2151: Applying manual color balance settings
Mar 21 21:01:55 allsky [INFO] ImageWorker002 scnr.maximum_neutral() #89: SCNR maximum neutral in 0.0178 s
Mar 21 21:01:55 allsky [INFO] ImageWorker002 stars.detectObjects() #86: Found 4 objects
Mar 21 21:01:55 allsky [INFO] ImageWorker002 stars.detectObjects() #84: Star detection in 1.4790 s
Mar 21 21:01:54 allsky [INFO] ImageWorker002 detectLines.detectLines() #81: Detected 0 lines
Mar 21 21:01:54 allsky [INFO] ImageWorker002 detectLines.detectLines() #78: Line detection in 0.1695 s
Mar 21 21:01:53 allsky [WARNING] ImageWorker002 image.recalculate_exposure() #1309: New calculated exposure: 20.000000
Mar 21 21:01:53 allsky [INFO] ImageWorker002 image.calculate_histogram() #1213: Brightness average: 43.57
Mar 21 21:01:53 allsky [INFO] ImageWorker002 image.processImage() #323: Image: 4056 x 3040
Mar 21 21:01:53 allsky [INFO] ImageWorker002 sqm.calculate() #42: Weighted SQM average: 40.74
Mar 21 21:01:53 allsky [INFO] ImageWorker002 sqm.calculate() #37: Raw SQM average: 40.74
Mar 21 21:01:53 allsky [INFO] ImageWorker002 sqm.calculate() #21: Exposure: 20.000000, gain: 1
Mar 21 21:01:53 allsky [WARNING] ImageWorker002 image._calibrate() #1844: Dark not found: ccd1 8bit 20.0000000s gain 1 bin 2 16.00c
Mar 21 21:01:53 allsky [WARNING] ImageWorker002 image._calibrate() #1826: Temperature matched dark not found: 16.00c
Mar 21 21:01:53 allsky [INFO] ImageWorker002 image._calibrate() #1809: Searching for dark frame: gain 1, exposure >= 20.0, temp >= 16.0c
Mar 21 21:01:53 allsky [WARNING] ImageWorker002 image._calibrate() #1797: Bad Pixel Map not found: ccd1 8bit 20.0000000s gain 1 bin 2 16.00c
Mar 21 21:01:53 allsky [WARNING] ImageWorker002 image._calibrate() #1779: Temperature matched bad pixel map not found: 16.00c
Mar 21 21:01:53 allsky [INFO] ImageWorker002 image._calibrate() #1762: Searching for bad pixel map: gain 1, exposure >= 20.0, temp >= 16.0c
Mar 21 21:01:53 allsky [INFO] ImageWorker002 image._detectBitDepth() #1706: Image max value: 255
Mar 21 21:01:53 allsky [INFO] ImageWorker002 image.add() #1653: Image bits: 8, cfa: None
Mar 21 21:01:52 allsky [INFO] MainProcess allsky._stopImageWorker() #808: Stopping ImageWorker process
Mar 21 21:01:52 allsky [WARNING] MainProcess allsky.run() #1206: Restarting processes
Mar 21 21:01:52 allsky [INFO] MainProcess allsky.run() #1174: Exposure received in 102.6227 s (82.6227)
Mar 21 21:01:48 allsky [INFO] MainProcess allsky._queueManualTasks() #2397: Checking for manually submitted tasks
Mar 21 21:01:48 allsky [INFO] MainProcess indi.getTelescopeRaDec() #844: Telescope Coord: RA 8.70, Dec 44.65
Mar 21 21:01:48 allsky [INFO] MainProcess allsky.detectMoonMode() #1575: Moon altitude: -27:31:12.8, phase 0.1%
Mar 21 21:01:48 allsky [INFO] MainProcess allsky.detectNight() #1558: Sun altitude: -26:40:12.1
Mar 21 21:01:48 allsky [INFO] MainProcess allsky.run() #1033: Exposure state: BUSY
Mar 21 21:01:48 allsky [INFO] MainProcess allsky.run() #1032: Camera last ready: 98.0s
</code>

Any idea? Any hint on how to try to reset the config?

MS

Hi Aaron,

it seems that I messed something in the config: I set maximum exposure to 15 secs but the system takes around 80 secs between images. Delay in config is 5 seconds so I can't seem to understand the problem, maybe something hung in the config on the DB?

This is what happens with libcamera when you run in JPEG/PNG mode (instead of DNG mode). libcamera's auto white balance and color correction cause the program to run for long periods of time. If you run in DNG raw mode, this does not happen.

I can only assume the same thing happens in TJ's all sky software, but I have not tried.

I've been following this post since it was created, knowing that I wanted to set it up. I finally got my old ASI290MC back from a friend, and proceeded to get some parts together. My goal for this build was to have something mobile, such that when I visit other places with better skies than mine, I could take it along.

The result of the effort on the hardware side is a PVC setup with a built-in tent spike for the ground that looks like this:



Inside the contraption is the camera, an RPi 4b+ and the power supply. An extension cord was added with the connection to the Pi power supply inside of the enclosure to protect it. I ended up cracking the dome when assembling, so have a different one ready to go.

The software has been working very well once connected, and the hardware is working as good as can be expected for an ageing CMOS camera with plenty of stuck pixels.

Thank you to everyone that helped make the software what it is today!



From this image, some observations:

1. my image sensor in the ASI290MC seems to not be centered with the lens. The right side of the image shows the barrel of the lens holder, and the left side does not. Not sure there is much that can be done here, maybe the circular cropping of the image would make it look better.
2. light pollution and clouds, yay.
3. my dome has glare, some possibly from the crack, some from the white surface. The PVC is not painted yet. I would go with a dark color, but then it will probably get too hot, and if I find a place in the shade during the day, that means part of the sky is obstructed.
4. daytime captures are great, clouds do crazy dances in timelapse
5. it would be nice if there was a way to send items that may not have uploaded correctly, from the viewer. Perhaps a `send this video` type link on each video that would match your criteria for the File Transfer configuration. I had some videos that did not get sent due to configuration issues, but I am not finding a way to send them later other than deleting them and re-creating them.
6. any of the text items that change as the image is being created overwrite each other in the top right, making a bit of a mess. Is this something I can configure around? If that data is written into the picture part of the image, there probably isn't much that can be done, but maybe that info can just be in the metadata part of the image, like EXIF? In this way, star trails and similar composite images would not be affected, but individual images could still display the information, or at least contain it?
7. My lens is only 150 degree. What cameras and lenses are people using to see closer to 170 degree?
8. Finally (geez), is there a place where people have been sharing images and videos created with this software?

I have seen the image circle being off center, but that is the worst case I have ever seen. The image sensor itself must be not centered to the body of the camera, it may be worth disassembling to fix.

I will get around to this eventually. The upload status (and S3 upload and SyncAPI) are tracked in the database.

The labels are part of the image itself. The only way to get rid of them is just disabling image labels entirely.

The FOV is a function of the lens and the image sensor. Getting a larger sensor will result in seeing more of the image circle, which expands the view a bit. The following lens is well known for a large image circle. It has gone by a few names, but can be hard to find:
www.dewcontrol.com/155mm_All_Sky_Camera_...099125_19122279.aspx

The Allsky Camera Facebook group has a lot of posts...
www.facebook.com/groups/172438633343696/

yeah, off-center is being nice to it. I took a look at the camera, but I don't have a tool narrow enough to reach down the hole to get to the screw heads... perhaps if I drop it in the other direction... I joke.. maybe. I did spin the lens to make sure it wasn't the lens elements, it isn't. The offset stays with the sensor while turning the entire lens.

Thanks for the video upload work over on github. Each one of the stills and videos shows things in a unique way.

I know the labels are written into the image, and I do like to see that information as well. I was just wondering if there might be a way to store the data in the image metadata layer, like exif, or fits header, such that a viewer could still display the data overlayed on the image if desired, but for stacking there would be nothing but sky. It does sound like a lot of work though.

I did look around a lot for another lens, as the FOV of this one leaves a bit to be desired, but it is the best I can get for now. Thanks to for the link, though I cannot find that one anywhere yet.

Jim

I have had sufficient people ask for the EXIF data so that is what I am working on now. To date, I have been using the OpenCV imread/imwrite commands to read/write images. Unfortunately, OpenCV does not support writing EXIF data and the developers do not really seem to be interested in implementing it.

Therefore, I am replacing the image IO with the Python Pillow module. The good news is Pillow appears to be significantly faster in these operations. Saving 20ms does not sound like much until you have to read 3000 images to generate a keogram. That is a full 1 minute speed improvement on a process that takes 10-15 minutes.

Using a Pi 4 8gb - installed indi-allsky.
I have a QHY678C i'm trying to connect to it but can't.
I did the fxload for usb 3.0 support but do not see an .img file for the qhy5iii678
Tried to do it with the 486 image file and didn't seem to work.

I'm going to try to reinstall everything.

Can you tell me if the 678 is supported?
.

There is a QHY5III678.img that was just added one month ago, probably for the indi 2.0.1 release. It will not be in the astroberry repo which is still at indi 1.9.7.

You can follow these instructions to remove the astroberry repo: github.com/aaronwmorris/indi-allsky/wiki...tall-indi-repository

Then you can run ./misc/build_indi.sh to compile indi from source. I believe it will take 30-40 minutes on a Pi4.

Any update/progress for the planetarium overlay? I think you’ve already tried with VirtualSky correct?

Disregard - all working - Driver problem.

I did make an attempt with VirtualSky. I could not get the VirtualSky [HTML5] canvas to overlay on top of the indi-allsky image canvas. TJ's allsky overlays the VirtualSky canvas on top of a plain <img> element, which is the primary difference.

I tried, but it is above my skill level with HTML.