×

INDI Library v2.0.7 is Released (01 Apr 2024)

Bi-monthly release with minor bug fixes and improvements

New All Sky camera management software: indi-allsky

  • Posts: 1309
  • Thank you received: 226
I did not move it. But I was getting warnings about some things not belonging to PATH. I can look into adding them and try again.
9 months 3 days ago #94235

Please Log in or Create an account to join the conversation.

  • Posts: 264
  • Thank you received: 66
I used one of my test systems and moved the git checkout and was able to basically recreate the issue. It does not have to be the git checkout directory itself, but also any parent directory.

Usually, virtualenvs are not relocatable. I know there are some options that have allowed it in the past, but I think --relocatable has been deprecated and removed.

Your best option in this case is just fully delete the virtualenv/indi-allsky/ folder and re-run setup again to have it recreated.

Edit: I have also discovered that when the folder gets moved, it causes modules and programs to be installed in /home/username/.local/bin (also lib/ share/ and include/). These probably need to be cleaned up, as well.
Last edit: 9 months 2 days ago by Aaron Morris.
9 months 2 days ago #94237

Please Log in or Create an account to join the conversation.

  • Posts: 201
  • Thank you received: 18

Saving the config and reloading fixed the problem with images not processing.
The following user(s) said Thank You: Aaron Morris
Last edit: 9 months 2 days ago by Thomas Mason.
9 months 2 days ago #94245

Please Log in or Create an account to join the conversation.

  • Posts: 4
  • Thank you received: 0
Hi,

I'm trying to setup sync api and I'm getting the following errors on the local allsky
Aug 23 21:47:31 allsky [INFO] MainProcess/MainThread allsky._fileUploadWorkerStart() #489: Starting Upload-8 worker
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception: 
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception: KeyError: 'asset_type'
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:     if metadata['asset_type'] == constants.ASSET_IMAGE:
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:   File "/home/pfleming/indi-allsky/indi_allsky/uploader.py", line 495, in _syncapi
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:     self._syncapi(entry, metadata)
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:   File "/home/pfleming/indi-allsky/indi_allsky/uploader.py", line 456, in processUpload
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:     self.processUpload(u_dict)
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:   File "/home/pfleming/indi-allsky/indi_allsky/uploader.py", line 127, in saferun
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:     self.saferun()
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception:   File "/home/pfleming/indi-allsky/indi_allsky/uploader.py", line 99, in run
Aug 23 21:47:31 allsky [ERROR] MainProcess/MainThread allsky._fileUploadWorkerStart() #482: Upload worker exception: Traceback (most recent call last):
Aug 23 21:47:30 allsky [INFO] MainProcess/Upload-7 uploader.processUpload() #439: Upload transaction completed in 0.6129 s
Aug 23 21:47:30 allsky [INFO] MainProcess/Upload-7 boto3_s3.put() #137: File transferred in 0.5921 s (2616.13 kB/s)
Aug 23 21:47:29 allsky [INFO] MainProcess/Upload-7 generic.put() #50: Uploading /var/www/html/allsky/images/ccd_41a4d35e-cd9c-4161-a41d-b3bbcef4de84/20230823/night/23_21/ccd1_20230823_214725.jpg
Aug 23 21:47:29 allsky [INFO] MainProcess/Upload-7 generic.connect() #40: Connecting to amazonaws.com (443) as * with boto3_s3
Aug 23 21:47:29 allsky [INFO] Image-1/MainThread miscUpload.s3_upload_image() #299: Uploading to S3 bucket
Aug 23 21:47:29 allsky [INFO] Image-1/MainThread miscDb.addImage() #177: Adding image /var/www/html/allsky/images/ccd_41a4d35e-cd9c-4161-a41d-

I've updated the local by doing a git pull and running the setup script again just to make sure they were in sync. I'm also using s3 object storage.

Thanks!
8 months 1 week ago #95116

Please Log in or Create an account to join the conversation.

  • Posts: 4
  • Thank you received: 0
Just wanted to update. Aaron fixed this in the latest code. I did a git pull and ran the setup and now things are working as expected. Thanks Aaron!

Pete
8 months 5 days ago #95219

Please Log in or Create an account to join the conversation.

  • Posts: 264
  • Thank you received: 66
Sorry, I did not see this post here. This was a very specific bug that would only occur if you used S3 Object Storage and SyncAPI.
8 months 5 days ago #95221

Please Log in or Create an account to join the conversation.

  • Posts: 74
  • Thank you received: 1
Hi all,
I've been trying to install indi-allsky on an Odroid C2 with Ubuntu 20.04. Everything goes ok until the end when I get the following error:
Collecting bottleneck (from -r /home/terryb/indi-allsky/requirements/requirements_debian11.txt (line 15))
Using cached Bottleneck-1.3.7.tar.gz (103 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... error
error: subprocess-exited-with-error

× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: -4
╰─> [7 lines of output]
running dist_info
creating /tmp/pip-modern-metadata-9p7_1zd6/Bottleneck.egg-info
writing /tmp/pip-modern-metadata-9p7_1zd6/Bottleneck.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-modern-metadata-9p7_1zd6/Bottleneck.egg-info/dependency_links.txt
writing requirements to /tmp/pip-modern-metadata-9p7_1zd6/Bottleneck.egg-info/requires.txt
writing top-level names to /tmp/pip-modern-metadata-9p7_1zd6/Bottleneck.egg-info/top_level.txt
writing manifest file '/tmp/pip-modern-metadata-9p7_1zd6/Bottleneck.egg-info/SOURCES.txt'
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.


The script exited abnormally, please try to run again...

I've tried restarting the script, tried the update indi option ....still the same.
Any ideas?
cheers
Terry
8 months 3 days ago #95264

Please Log in or Create an account to join the conversation.

  • Posts: 264
  • Thank you received: 66

I have tried to reproduce this error, but I cannot. You might try to fully upgrade all packages and see if that helps.

sudo apt-get update
sudo apt-get dist-upgrade

However, I believe the bottleneck module is technically optional, so you could just comment out/delete "bottleneck" from ./requirements/requirements_debian11.txt and re-run setup.sh . Bottleneck just accelerates certain numpy functions, but everything should run without it.
8 months 3 days ago #95280

Please Log in or Create an account to join the conversation.

  • Posts: 74
  • Thank you received: 1
Hi Aaron,,
sorry for the delay getting back......I've reinstalled ubuntu 20.04, followed your guidance, and get the following:

Downloading astroscrappy-1.1.0.tar.gz (368 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 368.5/368.5 kB 4.4 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: -4
╰─> [0 lines of output]
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: -4
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.


The script exited abnormally, please try to run again...

Hopefully you've got an idea.......
cheers
Terry
8 months 2 days ago #95296

Please Log in or Create an account to join the conversation.

  • Posts: 264
  • Thank you received: 66

I have a couple of leads, but I need a little more info about your system. If you could pull down the latest code, I have a new script "./misc/support_info.sh" that will streamline gathering useful information.

I also renamed the requirements files, so you may have to restore your files to the original state.
8 months 1 day ago #95308

Please Log in or Create an account to join the conversation.

  • Posts: 74
  • Thank you received: 1
Hi Aaron,
The saga continues......I pulled the latest, and moved my old requirements file over....The setup script failed...I renamed th old file to latest, re-ran, and still the same:
Collecting astroscrappy>=1.0.8 (from ccdproc->-r //home/terryb/indi-allsky/requirements/requirements_latest.txt (line 11))
Using cached astroscrappy-1.1.0.tar.gz (368 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: -4
╰─> [0 lines of output]
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: -4
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.


The script exited abnormally, please try to run again...

Here are the results from the other script:
#################################
### indi-allsky support info ###
#################################

Distribution: Ubuntu
Release: 20.04
Arch: aarch64
Bits: 64

CPUs: 4
Memory: 1767188 kB

Filesystems
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/root 30638092 5505272 25115720 18% /
devtmpfs 734828 0 734828 0% /dev
tmpfs 883592 0 883592 0% /dev/shm
tmpfs 176720 968 175752 1% /run
tmpfs 5120 0 5120 0% /run/lock
tmpfs 883592 0 883592 0% /sys/fs/cgroup
/dev/mmcblk0p1 130798 24884 105914 20% /media/boot
tmpfs 176716 0 176716 0% /run/user/1000

system python: Python 3.8.10

indiserver: /usr/bin/indiserver

indi version: 2.0.3

indi packages
ii libindi-data 2.0.3+202308010721~ubuntu20.04.1 all Instrument-Neutral Device Interface library -- shared data
ii libindi-dev 2.0.3+202308010721~ubuntu20.04.1 arm64 Instrument-Neutral Device Interface library -- development files
ii libindi1:arm64 2.0.3+202308010721~ubuntu20.04.1 arm64 Instrument-Neutral Device Interface library -- shared library

libcamera: not detected

libcamera packages

libcamera cameras
libcamera-hello not available

python packages
ii libpython3-dev:arm64 3.8.2-0ubuntu2 arm64 header files and a static library for Python (default)
ii libpython3-stdlib:arm64 3.8.2-0ubuntu2 arm64 interactive high-level object-oriented language (default python3 version)
ii libpython3.8:arm64 3.8.10-0ubuntu1~20.04.8 arm64 Shared Python runtime library (version 3.8)
ii libpython3.8-dev:arm64 3.8.10-0ubuntu1~20.04.8 arm64 Header files and a static library for Python (v3.8)
ii libpython3.8-minimal:arm64 3.8.10-0ubuntu1~20.04.8 arm64 Minimal subset of the Python language (version 3.8)
ii libpython3.8-stdlib:arm64 3.8.10-0ubuntu1~20.04.8 arm64 Interactive high-level object-oriented language (standard library, version 3.8)
ii libpython3.9:arm64 3.9.5-3ubuntu0~20.04.1 arm64 Shared Python runtime library (version 3.9)
ii libpython3.9-dev:arm64 3.9.5-3ubuntu0~20.04.1 arm64 Header files and a static library for Python (v3.9)
ii libpython3.9-minimal:arm64 3.9.5-3ubuntu0~20.04.1 arm64 Minimal subset of the Python language (version 3.9)
ii libpython3.9-stdlib:arm64 3.9.5-3ubuntu0~20.04.1 arm64 Interactive high-level object-oriented language (standard library, version 3.9)
ii python-apt-common 2.0.1ubuntu0.20.04.1 all Python interface to libapt-pkg (locales)
ii python-pip-whl 20.0.2-5ubuntu1.9 all Python package installer
ii python3 3.8.2-0ubuntu2 arm64 interactive high-level object-oriented language (default python3 version)
ii python3-appdirs 1.4.3-2.1 all determining appropriate platform-specific directories (Python 3)
ii python3-apt 2.0.1ubuntu0.20.04.1 arm64 Python 3 interface to libapt-pkg
ii python3-certifi 2019.11.28-1 all root certificates for validating SSL certs and verifying TLS hosts (python3)
ii python3-chardet 3.0.4-4build1 all universal character encoding detector for Python3
ii python3-dbus 1.2.16-1build1 arm64 simple interprocess messaging system (Python 3 interface)
ii python3-dev 3.8.2-0ubuntu2 arm64 header files and a static library for Python (default)
ii python3-distlib 0.3.0-1 all low-level components of python distutils2/packaging
ii python3-distro 1.4.0-1 all Linux OS platform information API
ii python3-distro-info 0.23ubuntu1.1 all information about distributions' releases (Python 3 module)
ii python3-distupgrade 2:18.04.38 all manage release upgrades
ii python3-distutils 3.8.10-0ubuntu1~20.04 all distutils package for Python 3.x
ii python3-filelock 3.0.12-2 all platform independent file locking module
ii python3-gi 3.36.0-1 arm64 Python 3 bindings for gobject-introspection libraries
ii python3-idna 2.8-1 all Python IDNA2008 (RFC 5891) handling (Python 3)
ii python3-importlib-metadata 1.5.0-1 all library to access the metadata for a Python package - Python 3.x
ii python3-lib2to3 3.8.10-0ubuntu1~20.04 all Interactive high-level object-oriented language (lib2to3)
ii python3-minimal 3.8.2-0ubuntu2 arm64 minimal subset of the Python language (default python3 version)
ii python3-more-itertools 4.2.0-1build1 all library with routines for operating on iterables, beyond itertools (Python 3)
ii python3-netifaces 0.10.4-1ubuntu4 arm64 portable network interface information - Python 3.x
ii python3-pip 20.0.2-5ubuntu1.9 all Python package installer
ii python3-pkg-resources 45.2.0-1ubuntu0.1 all Package Discovery and Resource Access using pkg_resources
ii python3-requests 2.22.0-2ubuntu1.1 all elegant and simple HTTP library for Python3, built for human beings
ii python3-requests-unixsocket 0.2.0-2 all Use requests to talk HTTP via a UNIX domain socket - Python 3.x
ii python3-setuptools 45.2.0-1ubuntu0.1 all Python3 Distutils Enhancements
ii python3-six 1.14.0-2 all Python 2 and 3 compatibility library (Python 3 interface)
ii python3-software-properties 0.99.9.12 all manage the repositories that you install software from
ii python3-tk:arm64 3.8.10-0ubuntu1~20.04 arm64 Tkinter - Writing Tk applications with Python 3.x
ii python3-update-manager 1:20.04.10.11 all python 3.x module for update-manager
ii python3-urllib3 1.25.8-2ubuntu0.2 all HTTP library with thread-safe connection pooling for Python3
ii python3-virtualenv 20.0.17-1ubuntu0.4 all Python virtual environment creator
ii python3-wheel 0.34.2-1ubuntu0.1 all built-package format for Python
ii python3-yaml 5.3.1-1ubuntu0.1 arm64 YAML parser and emitter for Python3
ii python3-zipp 1.0.0-1 all pathlib-compatible Zipfile object wrapper - Python 3.x
ii python3.8 3.8.10-0ubuntu1~20.04.8 arm64 Interactive high-level object-oriented language (version 3.8)
ii python3.8-dev 3.8.10-0ubuntu1~20.04.8 arm64 Header files and a static library for Python (v3.8)
ii python3.8-minimal 3.8.10-0ubuntu1~20.04.8 arm64 Minimal subset of the Python language (version 3.8)
ii python3.9 3.9.5-3ubuntu0~20.04.1 arm64 Interactive high-level object-oriented language (version 3.9)
ii python3.9-dev 3.9.5-3ubuntu0~20.04.1 arm64 Header files and a static library for Python (v3.9)
ii python3.9-minimal 3.9.5-3ubuntu0~20.04.1 arm64 Minimal subset of the Python language (version 3.9)
ii python3.9-venv 3.9.5-3ubuntu0~20.04.1 arm64 Interactive high-level object-oriented language (pyvenv binary, version 3.9)

Detected indi-allsky virtualenv
virtualenv python: Python 3.9.5
virtualenv PATH: /home/terryb/indi-allsky/virtualenv/indi-allsky/bin:/usr/local/bin:/usr/bin:/bin
virtualenv python modules
pkg_resources==0.0.0

#################################
### end support info ###
#################################

Cheers Terry....
8 months 1 day ago #95317

Please Log in or Create an account to join the conversation.

  • Posts: 264
  • Thank you received: 66

Everything appears to be in order. Would you be willing to setup something that would allow me to remote login to this system? Normally, more helpful error messages are shown, but I suspect there might be a deeper problem and it may be faster if I can poke around myself.
8 months 1 day ago #95336

Please Log in or Create an account to join the conversation.

Time to create page: 1.214 seconds