OpenStack Object Storage (swift)

Installing swift stats system

Asked by Marc

I'm following the steps on http://swift.openstack.org/overview_stats.html to setup the swift stats system but I'm unable to find the swift-account-stats-logger, swift-container-stats-logger & swift-log-uploader programs to run from a cronjob. They are not on my system anywhere.

I've installed swift from the swift-core-ppa-lucid repository. The following packages where installed:

$ dpkg --get-selections|grep swift
python-swift install
swift install
swift-account install
swift-proxy install

# this returns nothing
$ whereis swift-account-stats-logger
swift-account-stats-logger:

dpkg -L python-swift
/.
/usr
/usr/bin
/usr/bin/swift-drive-audit
/usr/bin/swift-init
/usr/share
/usr/share/python-support
/usr/share/python-support/python-swift.public
/usr/share/doc
/usr/share/doc/python-swift
/usr/share/doc/python-swift/changelog.Debian.gz
/usr/share/doc/python-swift/changelog.gz
/usr/share/doc/python-swift/copyright
/usr/share/pyshared
/usr/share/pyshared/test
/usr/share/pyshared/test/unit
/usr/share/pyshared/test/unit/proxy
/usr/share/pyshared/test/unit/proxy/test_server.py
/usr/share/pyshared/test/unit/obj
/usr/share/pyshared/test/unit/obj/test_auditor.py
/usr/share/pyshared/test/unit/obj/test_updater.py
/usr/share/pyshared/test/unit/obj/test_server.py
/usr/share/pyshared/test/unit/obj/test_replicator.py
/usr/share/pyshared/test/unit/stats
/usr/share/pyshared/test/unit/stats/test_access_processor.py
/usr/share/pyshared/test/unit/stats/test_account_stats.py
/usr/share/pyshared/test/unit/stats/test_log_processor.py
/usr/share/pyshared/test/unit/stats/test_log_uploader.py
/usr/share/pyshared/test/unit/stats/test_stats_processor.py
/usr/share/pyshared/test/unit/container
/usr/share/pyshared/test/unit/container/test_auditor.py
/usr/share/pyshared/test/unit/container/test_updater.py
/usr/share/pyshared/test/unit/container/test_server.py
/usr/share/pyshared/test/unit/container/test_replicator.py
/usr/share/pyshared/test/unit/common
/usr/share/pyshared/test/unit/common/test_internal_proxy.py
/usr/share/pyshared/test/unit/common/ring
/usr/share/pyshared/test/unit/common/ring/test_builder.py
/usr/share/pyshared/test/unit/common/ring/test_ring.py
/usr/share/pyshared/test/unit/common/test_direct_client.py
/usr/share/pyshared/test/unit/common/test_db_replicator.py
/usr/share/pyshared/test/unit/common/test_wsgi.py
/usr/share/pyshared/test/unit/common/test_db.py
/usr/share/pyshared/test/unit/common/test_daemon.py
/usr/share/pyshared/test/unit/common/test_constraints.py
/usr/share/pyshared/test/unit/common/test_utils.py
/usr/share/pyshared/test/unit/common/test_bench.py
/usr/share/pyshared/test/unit/common/middleware
/usr/share/pyshared/test/unit/common/middleware/test_acl.py
/usr/share/pyshared/test/unit/common/middleware/test_cname_lookup.py
/usr/share/pyshared/test/unit/common/middleware/test_swift3.py
/usr/share/pyshared/test/unit/common/middleware/test_domain_remap.py
/usr/share/pyshared/test/unit/common/middleware/test_memcache.py
/usr/share/pyshared/test/unit/common/middleware/test_healthcheck.py
/usr/share/pyshared/test/unit/common/middleware/test_auth.py
/usr/share/pyshared/test/unit/common/middleware/test_ratelimit.py
/usr/share/pyshared/test/unit/common/middleware/test_swauth.py
/usr/share/pyshared/test/unit/common/middleware/test_except.py
/usr/share/pyshared/test/unit/common/test_compressing_file_reader.py
/usr/share/pyshared/test/unit/common/test_client.py
/usr/share/pyshared/test/unit/common/test_memcached.py
/usr/share/pyshared/test/unit/common/test_bufferedhttp.py
/usr/share/pyshared/test/unit/common/test_exceptions.py
/usr/share/pyshared/test/unit/account
/usr/share/pyshared/test/unit/account/test_reaper.py
/usr/share/pyshared/test/unit/account/test_auditor.py
/usr/share/pyshared/test/unit/account/test_server.py
/usr/share/pyshared/test/unit/account/test_replicator.py
/usr/share/pyshared/test/unit/__init__.py
/usr/share/pyshared/test/unit/auth
/usr/share/pyshared/test/unit/auth/test_server.py
/usr/share/pyshared/test/functionalnosetests
/usr/share/pyshared/test/functionalnosetests/test_object.py
/usr/share/pyshared/test/functionalnosetests/test_container.py
/usr/share/pyshared/test/functionalnosetests/test_account.py
/usr/share/pyshared/test/functionalnosetests/swift_testing.py
/usr/share/pyshared/test/probe
/usr/share/pyshared/test/probe/test_account_failures.py
/usr/share/pyshared/test/probe/test_object_handoff.py
/usr/share/pyshared/test/probe/common.py
/usr/share/pyshared/test/probe/test_object_async_update.py
/usr/share/pyshared/test/probe/test_running_with_each_type_down.py
/usr/share/pyshared/test/probe/test_container_failures.py
/usr/share/pyshared/swift-1.2.0.egg-info
/usr/share/pyshared/swift-1.2.0.egg-info/top_level.txt
/usr/share/pyshared/swift-1.2.0.egg-info/SOURCES.txt
/usr/share/pyshared/swift-1.2.0.egg-info/dependency_links.txt
/usr/share/pyshared/swift-1.2.0.egg-info/PKG-INFO
/usr/share/pyshared/swift-1.2.0.egg-info/entry_points.txt
/usr/share/pyshared/swift
/usr/share/pyshared/swift/proxy
/usr/share/pyshared/swift/proxy/server.py
/usr/share/pyshared/swift/obj
/usr/share/pyshared/swift/obj/updater.py
/usr/share/pyshared/swift/obj/server.py
/usr/share/pyshared/swift/obj/auditor.py
/usr/share/pyshared/swift/obj/replicator.py
/usr/share/pyshared/swift/stats
/usr/share/pyshared/swift/stats/account_stats.py
/usr/share/pyshared/swift/stats/log_processor.py
/usr/share/pyshared/swift/stats/stats_processor.py
/usr/share/pyshared/swift/stats/log_uploader.py
/usr/share/pyshared/swift/stats/access_processor.py
/usr/share/pyshared/swift/container
/usr/share/pyshared/swift/container/updater.py
/usr/share/pyshared/swift/container/server.py
/usr/share/pyshared/swift/container/auditor.py
/usr/share/pyshared/swift/container/replicator.py
/usr/share/pyshared/swift/common
/usr/share/pyshared/swift/common/ring
/usr/share/pyshared/swift/common/ring/builder.py
/usr/share/pyshared/swift/common/ring/ring.py
/usr/share/pyshared/swift/common/ring/__init__.py
/usr/share/pyshared/swift/common/constraints.py
/usr/share/pyshared/swift/common/compressing_file_reader.py
/usr/share/pyshared/swift/common/daemon.py
/usr/share/pyshared/swift/common/memcached.py
/usr/share/pyshared/swift/common/bufferedhttp.py
/usr/share/pyshared/swift/common/wsgi.py
/usr/share/pyshared/swift/common/direct_client.py
/usr/share/pyshared/swift/common/client.py
/usr/share/pyshared/swift/common/bench.py
/usr/share/pyshared/swift/common/middleware
/usr/share/pyshared/swift/common/middleware/auth.py
/usr/share/pyshared/swift/common/middleware/healthcheck.py
/usr/share/pyshared/swift/common/middleware/swift3.py
/usr/share/pyshared/swift/common/middleware/swauth.py
/usr/share/pyshared/swift/common/middleware/acl.py
/usr/share/pyshared/swift/common/middleware/memcache.py
/usr/share/pyshared/swift/common/middleware/cname_lookup.py
/usr/share/pyshared/swift/common/middleware/ratelimit.py
/usr/share/pyshared/swift/common/middleware/catch_errors.py
/usr/share/pyshared/swift/common/middleware/domain_remap.py
/usr/share/pyshared/swift/common/internal_proxy.py
/usr/share/pyshared/swift/common/db_replicator.py
/usr/share/pyshared/swift/common/db.py
/usr/share/pyshared/swift/common/utils.py
/usr/share/pyshared/swift/common/__init__.py
/usr/share/pyshared/swift/common/exceptions.py
/usr/share/pyshared/swift/account
/usr/share/pyshared/swift/account/server.py
/usr/share/pyshared/swift/account/reaper.py
/usr/share/pyshared/swift/account/auditor.py
/usr/share/pyshared/swift/account/replicator.py
/usr/share/pyshared/swift/__init__.py
/usr/share/pyshared/swift/auth
/usr/share/pyshared/swift/auth/server.py

Any ideas?

Regards,
Marc

Question information

Language:
English Edit question
Status:
Solved
For:
OpenStack Object Storage (swift) Edit question
Assignee:
No assignee Edit question
Solved by:
Marc
Solved:
Last query:
Last reply:
Revision history for this message
gholt (gholt) said : 		#1

You have Swift 1.2.0 installed and therefore should use the 1.2 documentation at http://swift.openstack.org/1.2/ (or upgrade to a later version of Swift.

The http://swift.openstack.org/ docs are auto-generated from trunk (the latest development branch).

There are links in the right hand column on the trunk docs to the versioned docs; but your report gives me ammunition to get the links at the top of the first page too. :)

Revision history for this message
Marc (nerens) said : 		#2

Thank you for your message. If I look at the correct docs for my version I'm running, http://swift.openstack.org/1.2/overview_stats.html I still see references to swift-account-stats-logger, swift-log-uploader & swift-log-stats-collector (steps 8 to 11). I still have the problem that these are not on my system and I don't know how to install them?

Revision history for this message
gholt (gholt) said : 		#3

Ah, that must be a bug in the 1.2 packaging. It looks like those *should* be in the swift-account package. I'll try to get one the logging guys to chime in here.

Revision history for this message
gholt (gholt) said : 		#4

And, to correct myself a bit, the newest packages seem to show:

Package python-swift:
swift-log-uploader

Package swift-account:
swift-account-stats-logger
swift-container-stats-logger

Package swift:
swift-log-stats-collector

Revision history for this message
Marc (nerens) said : 		#5

We upgraded to trunk and the packages appeared. Thanks for your help.