librelist archives

« back to archive

How to use it as a replacement for make(1)?

How to use it as a replacement for make(1)?

From:
Nicolas Desprès
Date:
2014-05-14 @ 13:20
Hi,

I have just finished reading the documentation of joblib and I would like
to congratulate you guys for this impressive piece of work.

While reading the doc a statement catch my eyes: "Joblib can also be used
to provide a light-weight make replacement or caching solution."

Although I understand how the cache system works, I do not get how joblib
could replace make(1). make uses the file timestamp to figure out whether a
command has to be rerun or not. How can joblib do that since most of the
inputs/outputs are in memory? Does its approach only rely on the cache
system?

I looked for an example but could not find one about that in the examples/
directory or the repository.

Thanks,

-- 
Nicolas Desprès

Re: How to use it as a replacement for make(1)?

From:
Nicolas Desprès
Date:
2014-05-23 @ 07:42
On Wed, May 14, 2014 at 3:20 PM, Nicolas Desprès
<nicolas.despres@gmail.com>wrote:

> Hi,
>
> I have just finished reading the documentation of joblib and I would like
> to congratulate you guys for this impressive piece of work.
>
> While reading the doc a statement catch my eyes: "Joblib can also be used
> to provide a light-weight make replacement or caching solution."
>
> Although I understand how the cache system works, I do not get how joblib
> could replace make(1). make uses the file timestamp to figure out whether a
> command has to be rerun or not. How can joblib do that since most of the
> inputs/outputs are in memory? Does its approach only rely on the cache
> system?
>
> I looked for an example but could not find one about that in the examples/
> directory or the repository.
>
After further investigation of the source code repository. It appears that
the "make" feature has been written because it does not work (see
https://github.com/joblib/joblib/commit/392ecb630baae53567b372f588f373a96c4adbed).
So that answer my question about how it could be achieved. The
documentation should be updated then.

Cheers,

-- 
Nicolas Desprès

Re: [joblib] Re: How to use it as a replacement for make(1)?

From:
Olivier Grisel
Date:
2014-05-23 @ 08:07
Indeed, thanks for the report.

-- 
Olivier

Re: [joblib] Re: How to use it as a replacement for make(1)?

From:
Nicolas Desprès
Date:
2014-05-23 @ 11:15
On Fri, May 23, 2014 at 10:07 AM, Olivier Grisel
<olivier.grisel@ensta.org>wrote:

> Indeed, thanks for the report.
>
> Any plan to have it back?

-- 
Nicolas Desprès

Re: [joblib] Re: How to use it as a replacement for make(1)?

From:
Olivier Grisel
Date:
2014-05-23 @ 12:23
>> Indeed, thanks for the report.
>>
> Any plan to have it back?

No plan as far as I know.


-- 
Olivier
http://twitter.com/ogrisel - http://github.com/ogrisel