librelist archives

« back to archive

[GSoC 11] libgit2: midterm report

[GSoC 11] libgit2: midterm report

Carlos Martín Nieto
2011-07-19 @ 00:07
Hello everyone,

As it's the GSoC midterm and I'm taking a rest from coding (my exams are
in the next few days) I'm taking this opportunity to write up a more
detailed report on what has been happening on the libgit2 network front.
All the code is available from my 'fork' on github.

The more useful working code has been merged into mainline, and you can
get a list of references on the remote. If you want to filter which
references you want to see, you can do that as well (with some manual
work). I had hoped that fetching and/or pack indexing would be working
by now, but sadly the university got in the way. At any rate, here's a
list of what's working/implemented:


I believe all the important stuff has been implemented. You can get one
from a remote and you can see if a string matches what it describes. You
can also transform  a string/path from the source to the destination
form (this probably has a different name in git.git). The transformation
code assumes that a '*' in the destination implies that there is a '*'
at the end of the source name as well. This might need to be 'hardened'.


You can parse its information from the configuration file (the push and
fetch refspecs will be parsed as well) and an appropriate transport (see
below) will be chosen based on the URL prefix. Right now there is a
static list, but plug-ins could be supported without much effort if
somebody can come up with an use-case. It is through these transports
that everything is done through the network (or simulating the network,
as in the local filesystem "network" transport).


This is where most of the work actually happens. Each transport
registers its callbacks in a structure and does its work transparently.
The data structures are still in flux, as I haven't yet found the best
way to avoid duplicating the information in several places, and the
want/have/need code is really still in it infancy. The idea is that the
object list you get when you connect can be used to mark which commits
you want to receive or send. Right now only the local filesystem and
git/tcp are implemented; and the only working operation is

   _Sliding memory maps, packfile reading and the indexer_

Or whatever you want to call them; I believe it's mmfile in git. This
code and the packfile reading code live in the "pack ODB backend" so I'm
making it somewhat more generic so I can use it without an ODB backend.
Once that code is decoupled (which is a good change on its own), writing
and indexer shouldn't be too hard.


So this is where I am now. I'm a bit behind according to the original
schedule but still on track to finish on time. It's been interesting and
fun, sometimes a bit frustrating. Thanks to all the people who have
helped me thus far.