Ubuntu Distributed Development

Failure to import non-ascii filenames

Bug #508258 reported by Andrew Starr-Bochicchio on 2010-01-16

This bug affects 2 people

Affects		Status	Importance	Assigned to	Milestone
	Ubuntu Distributed Development	Fix Released	High	Martin Packman
	bzr-builddeb	Fix Released	High	Martin Packman	bzr-builddeb 2.8

Bug Description

There are no bazaar source branches for the “gnome-games” package in Ubuntu on Launchpad. See:

https://code.edge.launchpad.net/ubuntu/+source/gnome-games/+branches

http://package-import.ubuntu.com/failures/gnome-games

Failed at 2010-01-12 21:11:15.048327

Traceback (most recent call last):
  File "./import_package.py", line 788, in <module>
    no_existing=options.no_existing))
  File "./import_package.py", line 713, in main
    import_package(temp_dir, importp, revid_db, bstore, possible_transports=possible_transports)
  File "./import_package.py", line 481, in import_package
    use_time_from_changelog=True)
  File "/srv/package-import.canonical.com/new/scripts/plugins/builddeb/import_dsc.py", line 1481, in import_package
    file_ids_from=file_ids_from)
  File "/srv/package-import.canonical.com/new/scripts/plugins/builddeb/import_dsc.py", line 1376, in _do_import_package
    timestamp=timestamp, file_ids_from=file_ids_from)
  File "/srv/package-import.canonical.com/new/scripts/plugins/builddeb/import_dsc.py", line 1244, in import_debian
    file_ids_from=parent_trees + debian_trees)
  File "/srv/package-import.canonical.com/new/scripts/plugins/builddeb/import_dsc.py", line 160, in import_dir
    import_archive(tree, dir_file, file_ids_from=file_ids_from)
  File "/srv/package-import.canonical.com/new/scripts/plugins/builddeb/import_dsc.py", line 235, in import_archive
    trans_id = tt.trans_id_tree_path(relative_path)
  File "/usr/lib/python2.5/site-packages/bzrlib/transform.py", line 241, in trans_id_tree_path
    path = self.canonical_path(path)
  File "/usr/lib/python2.5/site-packages/bzrlib/transform.py", line 1294, in canonical_path
    abs = self._tree.abspath(path)
  File "/usr/lib/python2.5/site-packages/bzrlib/workingtree.py", line 395, in abspath
    return pathjoin(self.basedir, filename)
  File "/usr/lib/python2.5/posixpath.py", line 65, in join
    path += '/' + b
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 1: ordinal not in range(128)

See original description

Tags:

Related branches

lp:~gz/bzr-builddeb/nonascii_import_dir_508258

Merged into lp:bzr-builddeb at revision 637

Jelmer Vernooij: Approve (code) on 2011-10-24

Andrew Starr-Bochicchio (andrewsomething) on 2010-01-17

description:

updated

John A Meinel (jameinel) on 2010-01-27

summary:	- No source branches for “gnome-games” package in Ubuntu + Failure to import non-ascii filenames
description:	updated
Changed in udd:
importance:	Undecided → Medium
status:	New → Confirmed

James Westby (james-w) on 2010-04-22

tags:

added: bzr

James Westby (james-w) on 2010-10-01

description:	updated
tags:	added: import-failure main

James Westby (james-w) on 2010-10-02

description:	updated
description:	updated

James Westby (james-w) on 2010-10-02

description:	updated
description:	updated

James Westby (james-w) on 2010-10-02

description:

updated

James Westby (james-w) on 2010-10-02

description:

updated

James Westby (james-w) on 2010-10-02

description:

updated

Jonathan Riddell (jr) on 2011-09-21

Changed in udd:
assignee:	nobody → Jonathan Riddell (jr)

Revision history for this message

Jonathan Riddell (jr) wrote on 2011-09-22:

The current UnicodeDecodeErrors seem to be caused by non utf-8 filenames in packages. These are fine when held in str variables but when they get converted to unicode they get converted back to utf-8 when reading the file which does not exist.

I managed some success by forcing strings be to encoded as iso-8859-1 on package liblingua-de-ascii-perl but the errors moved into bzrlib and I couldn't track them down.

Changed in udd:
assignee:	Jonathan Riddell (jr) → nobody

Revision history for this message

Jelmer Vernooij (jelmer) wrote on 2011-09-22:

how are we converting these non-utf8 filenames to unicode at the moment, do we just assume they're in iso8859-1 ?

Martin Pool (mbp) on 2011-10-04

Changed in udd:
importance:	Medium → Low
importance:	Low → High

Revision history for this message

Jonathan Riddell (jr) wrote on 2011-10-04:

It'll just use whatever the system locale is

Martin Packman (gz) on 2011-10-24

Changed in bzr-builddeb:
assignee:	nobody → Martin Packman (gz)
importance:	Undecided → High
status:	New → In Progress

Martin Packman (gz) on 2011-10-25

Changed in bzr-builddeb:
milestone:	none → 2.8
status:	In Progress → Fix Committed

Revision history for this message

Martin Packman (gz) wrote on 2011-10-25:

Deployed the bzr-builddeb fix and requeued packages with this issue.

Many should now succeed, those that don't should be categorised under:

<http://package-import.ubuntu.com/status/08eff66a5fe37a967e2f2b06210cc608.html>

Resolving those probably depends on bug 63324 in bzrlib.

Changed in udd:
assignee:	nobody → Martin Packman (gz)
status:	Confirmed → Fix Released

Jelmer Vernooij (jelmer) on 2011-12-16

Changed in bzr-builddeb:
status:	Fix Committed → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

Duplicates of this bug

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.