limewire import failing

Asked by Robert Collins on 2009-07-17

Limewire's import is failing. It claims a timeout, but the log shows:

Traceback (most recent call last):
... totla.totla(config, self._logger, config.args, SCM.tree(source_dir))
  File "cscvs/cmds/totla.py", line 229, in totla
    apply.rangeParser = source_tree.changesetRangeParser(
  File "CVS/__init__.py", line 538, in changesetRangeParser
    return RangeArgParser(self.catalog(mode_hint="update", tlaBranchName=targetBranchName))
  File "CVS/__init__.py", line 523, in catalog
    self._catalog = self.refreshCatalog(inputfile, self.logger(), readOnly, dryRun, fuzzhours, tlaBranchName=tlaBranchName)
  File "CVS/__init__.py", line 657, in refreshCatalog
    return self.newCatalog(inputfile,logger, readOnly, dryRun, tlaBranchName=tlaBranchName)
  File "CVS/__init__.py", line 633, in newCatalog
    self.buildCatalog(pipe, catalog, default, tlaBranchName=tlaBranchName)
  File "CVS/__init__.py", line 506, in buildCatalog
    revisions,parser=self.cvsLogToRevisions(pipe, default)
  File "CVS/__init__.py", line 569, in cvsLogToRevisions
    parser.parse(pipe, self.repositoryLocation())
  File "CVS/Parser.py", line 209, in parse
    saved_revisions = list(self.revisions_list)
MemoryError
Import failed:
Traceback (most recent call last):
Failure: twisted.internet.error.ProcessTerminated: A process has ended with a probable error condition: process ended with exit code 1.

Which suggests two things to me:
the code import is failing to error appropriately, and then hanging for an hour ;)
This import may need manual sheparding but doesn't necessarily have a bug preventing it completing.

Question information

Language:
English Edit question
Status:
Answered
For:
Launchpad itself Edit question
Assignee:
Paul Hummer Edit question
Last query:
2009-07-30
Last reply:
2009-07-30
Whiteboard:
assigning to rockstar to look at. michael.nelson 20090720
Karl Fogel (kfogel) said : #1

rockstar, any news?

The import just uses more RAM than we have in the machines that run the imports.

If we could perform the initial import on some other machine, we could probably update it fine on the import slaves, but I don't know how likely that is.

Robert Collins (lifeless) said : #3

On Thu, 2009-07-30 at 22:05 +0000, Michael Hudson wrote:
> Question #77344 on Launchpad Bazaar Integration changed:
> https://answers.edge.launchpad.net/launchpad-code/+question/77344
>
> Status: Needs information => Answered
>
> Michael Hudson proposed the following answer:
> The import just uses more RAM than we have in the machines that run the
> imports.
>
> If we could perform the initial import on some other machine, we could
> probably update it fine on the import slaves, but I don't know how
> likely that is.

What is needed to try this?

-Rob

A machine with a lot of RAM (more than 4 gigs) that can connect on the internet on port 2401. If you manage to import it once and give me the CVS checkout and the resulting branch, I can stitch that into the code import system.

Can you help with this problem?

Provide an answer of your own, or ask Robert Collins for more information if necessary.

To post a message you must log in.