Hi,
this patch addresses an issue we have recently seen in our production
systems due to a stale MIDX. The MIDX contained entries for packfiles
that didn't exist anymore, which caused Git to repeatedly look up those
packfiles. Each missing packfile resulted in four repeated syscalls:
three access(3p) calls to check for supporting data structures, and one
call to stat(3p) to check for the packfile itself. The first three calls
are essentially wasted though when the stat(3p) call itself fails, which
is being fixed by this patch.
I doubt that the patch matters in almost any repository, but given that
the refactoring is trivial I thought to submit the patch regardless of
that. Another step would be to introduce a negative lookup cache -- but
that would be a bit more involved, so I decided against it for now as I
don't want to introduce complexity for dubious gains.
Changes in v2:
- Drop the patch that reorders syscalls and add a comment explaining
why the order is important.
- Add a negative lookup cache for indexed packfiles.
- Link to v1: https://lore.kernel.org/r/20250516-pks-pack-avoid-stats-on-missing-v1-1-e2ef4d8798a3@xxxxxx
Thanks!
Patrick
---
Patrick Steinhardt (2):
packfile: explain ordering of how we look up auxiliary pack files
midx: stop repeatedly looking up nonexistent packfiles
midx.c | 10 ++++++++--
packfile.c | 11 +++++++++++
2 files changed, 19 insertions(+), 2 deletions(-)
Range-diff versus v1:
1: 31ffb3712ca < -: ----------- packfile: avoid access(3p) calls for missing packs
-: ----------- > 1: 6125b84389d packfile: explain ordering of how we look up auxiliary pack files
-: ----------- > 2: 8cb82a771c0 midx: stop repeatedly looking up nonexistent packfiles
---
base-commit: 1a8a4971cc6c179c4dd711f4a7f5d7178f4b3ab7
change-id: 20250516-pks-pack-avoid-stats-on-missing-8e3b75755cf0
