hockeypuck-dev team mailing list archive

[Jason Harris <jharris@xxxxxxxxxxxxx>]

On Sun, Sep 15, 2013 at 11:25:20AM -0400, Jason Harris wrote:
> I think hockeypuck-import could have some state machine/logic errors
> in io.go.  Importing a keyring with a single key, my 0xd39da0e3,
> never added a row to the openpgp_pubkey table!
 
> I also instrumented hockeypuck-import to give me some simple stats
> (every 100 keys, and when done with each file):
 
> and I'm concerned that it doesn't report all 15,000 keys each time,
> usually "counting" 800+ keys less.

[update]
After reloading just one (random - they all should do this) SKS keydump
file, I extracted the 14,182 long keyids (NB: only 14,157 were "reported"):

  SELECT UPPER (REVERSE (LEFT (uuid, 16))) FROM openpgp_pubkey;

and found that the unprocessed keys included:

  CE040C74F9A3F1DD
  BDAB86311EA5DE89
  DE0F188A5DA5E3C9
  6EBEE4263F9061AB
  34455AFCD61E9601
  29CF4A9919737805
  77C70CBE6DCEDF3F
  BA828960EFD5ECDB
  65608399FB848C07
  86528E4D3A6BFA5D
  8C9A3DBFC98B1335
  EA3317492193C607
  BF9EC700BC4B6FB1
  0760DF64B3D82239
  01758851F734C245
  6686DFC848749445

GPG (1.4.14) can't stomach much of this SKS keydump file, but it does
let us see that hockeypuck-import (revno: 205) isn't importing V3 keys:

  %gpg --no-default-keyring --keyring ./sks-dump-0000.pgp \
	--with-fingerprint -k CE040C74F9A3F1DD
  pub   1024R/F9A3F1DD 1997-05-03
	Key fingerprint = 39 7A B8 63 6F 28 CF 63  03 7B FB 1F B7 05 03 9F
  [snip]
  gpg: mpi too large for this implementation (56104 bits)
  gpg: mpi too large for this implementation (31822 bits)
  gpg: mpi too large for this implementation (35677 bits)
  gpg: keydb_search failed: invalid packet

> In other news, I'm loading ~100 keys/second on an old laptop (FreeBSD 9.1).

And, strangely, on a much beefier desktop as well (also FreeBSD 9.1).
Perhaps one transaction per key should be changed to one transaction
per file for hockeypuck-import.

-- 
Jason Harris           |  PGP:  This _is_ PGP-signed, isn't it?
jharris@xxxxxxxxxxxxx _|_ Got photons? (TM), (C) 2004

Attachment: pgpcM_k7B5mZR.pgp
Description: PGP signature