mlpack IRC logs, 2020-03-22

Logs for the day 2020-03-22 (starts at 0:00 UTC) are shown below.

March 2020
Sun
Mon
Tue
Wed
Thu
Fri
Sat
1
2
3
4
5
6
7
8
9
10
11
12
13
21
22
23
24
25
26
27
--- Log opened Sun Mar 22 00:00:39 2020
00:29 -!- togo [~togo@2a02:6d40:34db:fd01:b5ea:2c52:90be:51ed] has quit [Quit: Leaving]
03:06 < jeffin143[m]> It's time , Google should keep Google winter of code too :)
03:07 < jeffin143[m]> Mlpack will be growing at 10x seed 🤪
03:07 < jeffin143[m]> Speed*
03:35 < rcurtin> okay, very nearly got all the memory leaks... just two left, but I think I'll call it a night for now
06:14 < hemal[m]> Does MLpack support hdf5 files ?
06:14 < hemal[m]> Could a model and weights be loaded from hdf5 files and stored to that format ?
06:16 < Saksham[m]> HDF5 is a supported by armadillo
06:16 < Saksham[m]> (edited) ... supported by armadillo => ... supported file type of armadillo
06:17 < Saksham[m]> So it can be used to load matrices, etc
06:18 < hemal[m]> Thanks
06:20 < hemal[m]> Also, I was wondering,
06:20 < hemal[m]> Could mlpack be used as a backend to keras ?
06:25 < SriramSKGitter[m> @hemal : I assume custom python bindings would have to be added. It does sound like a great idea though :)
06:42 < hemal[m]> Sriram S K (Gitter): Thanks!
06:42 < hemal[m]> Any more opinions/ideas on this?
06:58 < SriramSKGitter[m> I'm afraid not hemal, I'm not too familiar with the bindings system, @rcurtin would probably know the right way to go about it. In addition this might be of some help: https://www.mlpack.org/doc/mlpack-3.2.2/doxygen/bindings.html
07:42 < hemal[m]> Thanks, I'll get back to this soon.
08:23 < jenkins-mlpack2> Project docker mlpack nightly build build #649: STILL UNSTABLE in 4 hr 9 min: http://ci.mlpack.org/job/docker%20mlpack%20nightly%20build/649/
08:52 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/aQdZZJDwOkaTUrPVNWmNWKcY >
08:53 < hemal[m]> * submit a PR for data::load() and data::save() for sp_mat in MLpack ?
08:55 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/fTmnOxkjjirFSnUSqShvyufM >
09:11 -!- AbhiSaphire [75d4f6bb@117.212.246.187] has joined #mlpack
09:27 * jeffin143[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/cYKSSKaebfBtKgYIVOaaJrPN >
09:37 < hemal[m]> jeffin143: As you are involved in ohe, please go ahead with ohe with sp_mat,
09:37 < hemal[m]> If possible, please share the PR link here, so that I could have a look.
09:40 < jeffin143[m]> Definitely , I would really like to hear your inputs on it :)
09:50 -!- ImQ009 [~ImQ009@unaffiliated/imq009] has joined #mlpack
10:35 -!- togo [~togo@2a02:6d40:34db:fd01:d1c3:9779:8ab4:3e07] has joined #mlpack
10:43 -!- favre49 [~favre49@106.51.29.244] has joined #mlpack
11:21 < himanshu_pathak[> zoq: I will try make to make a PR to create copy constructor for all layers
11:24 -!- noaima [31cf95cc@49.207.149.204] has joined #mlpack
11:24 < himanshu_pathak[> Anything else needed to do this
11:25 < himanshu_pathak[> May be some follow up steps will be helpfullzoq:
11:49 -!- noaima [31cf95cc@49.207.149.204] has quit [Remote host closed the connection]
12:03 -!- noaima [31cf95cc@49.207.149.204] has joined #mlpack
12:13 < AbishaiEbenezerG> @joeljosephjin i will require your help...
12:15 < JatoJoseph[m]> <zoq "Jato Joseph: Hello, mlpack.org/g"> Thanks alot zoq
12:22 -!- noaima [31cf95cc@49.207.149.204] has quit [Remote host closed the connection]
13:11 -!- AbhiSaphire [75d4f6bb@117.212.246.187] has quit [Remote host closed the connection]
13:50 -!- JatoJoe [c5d23418@197.210.52.24] has joined #mlpack
13:51 < JatoJoe> Hello. Glad to be here. Prospective Gsoc intern
13:54 -!- JatoJoe [c5d23418@197.210.52.24] has quit [Remote host closed the connection]
14:01 < zoq> himanshu_pathak[: You can just start with a single layer, don't think there is anything I can add, Ryam already pointed out what has to be changed.
14:01 < AbishaiEbenezerG> hi @zoq! Got a query here
14:01 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/paMqaZbTsllsMYYHHZtZcQUj >
14:02 < hemal[m]> Same as zoq said.
14:03 < zoq> hemal[m]: I think this is pretty straightforward, so I don't think we have to open a PR for each layer.
14:03 < hemal[m]> Ok cool
14:03 < zoq> Don't want to end up with 20 PR :)
14:03 < hemal[m]> Right !
14:10 < himanshu_pathak[> zoq (@freenode_zoq:matrix.org): I have started working on it I will raise a pr soon thanks for helping hemal: I agree with zoq we should do this in a single pr not multiple pr
14:43 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/ioafotjwONiIpxSXDadtrsiR >
14:45 < hemal[m]> An initial feedback would be of much help.
14:45 < hemal[m]> Also,
14:45 < hemal[m]> We could discuss on why we need arma::sp_mat as an input in the first place.
14:46 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/vQKXBGIRyqVDtHWZBKbQGvbm >
14:47 * jeffin143[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/IsQkfKlgBPLlHeihcbSJxnWg >
14:52 < hemal[m]> jeffin143: yes, armadillo has sp_mat.
14:52 < hemal[m]> My point is data::load() data::save() do not have support for sp_mat. They work on arma::mat, arma::col etc.
14:53 < hemal[m]> So,
14:53 < hemal[m]> 1. Do we require sp_mat in data::load(), data::save()
14:53 < hemal[m]> 2. If yes, how to go about doing that?
14:57 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/HviPfZwNdLHNxsHLFrbZiSCY >
14:58 < jeffin143[m]> Definitely , that would help , what I would suggest is add a template option for one of load function and use that in arma::mat and arma::spmat to load a really big csv file or something , like really big and see relatively speed bump or may be a space benchmark to
14:59 < jeffin143[m]> I am not sure if that would give speed bump, but we can surely check*
15:00 < hemal[m]> Thanks!
15:04 < hemal[m]> I was editing the existing data::load(),
15:04 < hemal[m]> Totally forgot overloading,
15:04 < hemal[m]> Thanks.
15:13 < AbishaiEbenezerG> hi mlpack
15:13 < AbishaiEbenezerG> I have a problem compiling a test file
15:15 < AbishaiEbenezerG> @joeljosephjin was able to compile and execute the exact same code without any problems..
15:16 < AbishaiEbenezerG> i've been trying to get past this for a week and i still don't know what i'm doing wrong..
15:16 < AbishaiEbenezerG> [![Screenshot from 2020-03-22 11-14-31.png](https://files.gitter.im/mlpack/mlpack/Tlpp/thumb/Screenshot-from-2020-03-22-11-14-31.png)](https://files.gitter.im/mlpack/mlpack/Tlpp/Screenshot-from-2020-03-22-11-14-31.png)
15:17 < AbishaiEbenezerG> I hope someone can help me for a few minutes on this
15:17 < AbishaiEbenezerG> Am i compiling it wrong ???
15:18 < PrinceGuptaGitte> you're not doing -lmlpack
15:18 < PrinceGuptaGitte> (edited) ... not doing -lmlpack => ... not using -lmlpack
15:21 < AbishaiEbenezerG> [![Screenshot from 2020-03-22 20-51-06.png](https://files.gitter.im/mlpack/mlpack/JxT5/thumb/Screenshot-from-2020-03-22-20-51-06.png)](https://files.gitter.im/mlpack/mlpack/JxT5/Screenshot-from-2020-03-22-20-51-06.png)
15:23 < SriramSKGitter[m> Are you sure mlpack is installed? Is `libmlpack.so` present in /usr/local/lib or elsewhere on your system?
15:24 < AbishaiEbenezerG> its in /build/lib
15:24 < AbishaiEbenezerG> mlpack/build/lib
15:25 < SriramSKGitter[m> Did you run the `make install` command?
15:27 < AbishaiEbenezerG> build doesn't show up unless i run that cmd right..?
15:29 < AbishaiEbenezerG> ok i think i messed it up. i'm so sorry
15:29 < SriramSKGitter[m> The `make` command compiles the source code and the compiled library is placed in `build/lib`. To complete the process (installing command line executables etc., add mlpack to system libraries in `/usr/local/lib`) , you should run `make install`. :)
15:30 < AbishaiEbenezerG> I hadn't run make install in this directory. I'm not sure whether to cry or laugh at this - it took me a week!!
15:31 < SriramSKGitter[m> We all started from somewhere :)
15:31 < AbishaiEbenezerG> I'll get back when its done @sriramsk1999 .
15:37 < AbishaiEbenezerG> CMake Error at cmake_install.cmake:41 (file):
15:37 < AbishaiEbenezerG> file INSTALL cannot make directory "/usr/local/include/ensmallen_bits":
15:37 < AbishaiEbenezerG> Permission denied.
15:38 < AbishaiEbenezerG> this was the last line line of the make install
15:38 < AbishaiEbenezerG> [![Screenshot from 2020-03-22 21-08-30.png](https://files.gitter.im/mlpack/mlpack/O4ez/thumb/Screenshot-from-2020-03-22-21-08-30.png)](https://files.gitter.im/mlpack/mlpack/O4ez/Screenshot-from-2020-03-22-21-08-30.png)
15:39 < AbishaiEbenezerG> @sriramsk1999
15:43 < PrinceGuptaGitte> did you try `sudo make install`
15:45 < AbishaiEbenezerG> Doing...
15:52 < AbishaiEbenezerG> @prince776 @sriramsk1999 Thank you so much for your help!!!
15:52 < AbishaiEbenezerG> I'm sorry . This was terribly dumb of me...
15:52 < AbishaiEbenezerG> Thank you for your patience!
15:53 < PrinceGuptaGitte> welcome. Also if you see permission denied in linux, sudo is mostly the answer(but also keep in mind, what you're doing can potentially change your system settings)
15:53 < PrinceGuptaGitte> (edited) ... linux, sudo is ... => ... linux, `sudo` is ...
15:53 < PrinceGuptaGitte> I had to reinstall Ubuntu for the same reason :)
15:54 < AbishaiEbenezerG> yes yes. i had done similar things before...
15:54 < AbishaiEbenezerG> but it beats me that this took me a week
15:55 < AbishaiEbenezerG> i'm literally just sitting in shock..
15:55 < AbishaiEbenezerG> Are these stuff documented somewhere?
15:55 < AbishaiEbenezerG> oh yes it is
15:56 < PrinceGuptaGitte> Yes, here it is https://www.mlpack.org/docs.html
15:56 < AbishaiEbenezerG> yupp
15:57 < AbishaiEbenezerG> you had to reinstall ubuntu ? Why did that happen?
15:58 < AbishaiEbenezerG> ok i think i know why i didn't run the make install in the first place.
15:58 < PrinceGuptaGitte> I don't remember what I did, but essentially i encountered some problems with apt-get, then copy pasted some commands and my system was in shambles
15:59 < AbishaiEbenezerG> make -j4 literally took the entire day. I even discussed it here..
15:59 < AbishaiEbenezerG> and i was so impatient to run the tests..
16:01 < AbishaiEbenezerG> > Even with just 1 core make-ing mlpack , it shouldn't take this long.
16:01 < AbishaiEbenezerG> remember this? I've been ruined since that day
16:01 < AbishaiEbenezerG> you helped me even then
16:01 < PrinceGuptaGitte> Oh yes I remember you were having a hard time with multiple cores
16:01 < AbishaiEbenezerG> Yes
16:02 < PrinceGuptaGitte> does it work fine now? or are you avoiding mutiple cores
16:02 < AbishaiEbenezerG> Multiple core works fine now since the initial build is done
16:03 < jeffin143[m]> hemal (@hemal:matrix.org): you there ?
16:03 < AbishaiEbenezerG> but i'm not planning on trying that out all over again. One day is too much to give up. But i should try it sometime later ...
16:04 < AbishaiEbenezerG> Ok. time to actually start learning the stuff that matter..
16:04 < AbishaiEbenezerG> Thank you so much for the help!
16:04 < PrinceGuptaGitte> good luck, also if you're going to deal with ANN codebase, learning how FFN<> class works is crucial
16:06 < AbishaiEbenezerG> Yeah, i"ve gone through that code . I have the workflow all in pencil and paper here - now i'll actually try stuff out
16:08 < hemal[m]> jeffin143: had gone for a walk, now i'm back,
16:21 < LakshyaOjhaGitte> Isn't your city in lock down too?
16:25 < hemal[m]> Curfew was till 9 pm. I went down at 9:05 pm to get some fresh air for 5 mins.
16:25 < hemal[m]> Thanks for the concern.
16:31 < LakshyaOjhaGitte> No worries
16:32 < LakshyaOjhaGitte> My city got locked down now till 31st. :(
16:32 < PrinceGuptaGitte> same
16:33 < hemal[m]> just pray that the lockdown works and it is not extended any further.
16:39 < LakshyaOjhaGitte> Lets hope so.
16:41 < PrinceGuptaGitte> How do I run my MLPack application with BLAS?
16:45 < PrinceGuptaGitte> also one more question, when using batch norm after convolution network, I just do it with `model.Add<BatchNorm<>>(channels*width*height)` right?
16:45 < PrinceGuptaGitte> (edited) ... convolution network, I ... => ... convolution layer, I ...
16:54 < PrinceGuptaGitte> > How do I run my MLPack application with BLAS?
16:54 < PrinceGuptaGitte> I tried -lblas but no performace improvement was seen.
16:54 * PrinceGuptaGitte sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/rlwXQWIpwgVXnQmaflgiBQyo >
16:54 < PrinceGuptaGitte> > How do I run my MLPack application with BLAS?
16:54 < PrinceGuptaGitte> I tried -lblas but no performace improvement was seen.
17:08 < PrinceGuptaGitte> > How do I run my MLPack application with BLAS?
17:08 < PrinceGuptaGitte> I tried -lblas but no improvement in performance is seen.
17:15 < Param-29Gitter[m> try installing OpenBLAS and running it with lopenblas
17:15 < Param-29Gitter[m> -lopenblas*
17:17 < Param-29Gitter[m> Hey @rcurtin ,@zoq how do we test if program is performing better when it uses OpenMP?
17:19 < Param-29Gitter[m> because I tired doing profiling but some algorithms perform better in serial than it did in parallel
17:19 < Param-29Gitter[m> I can upload a repository would you like to have a look on those results?
17:21 < Param-29Gitter[m> (I ran my test on thyroid dataset.)
17:27 < jeffin143[m]> hemal (@hemal:matrix.org): there are chances that sp_mat will not work for load and save
17:28 < jeffin143[m]> Because there are many functions which are only supported for matrix and not for sp_mat and hence if some of these are used them it will throw error
17:32 < PrinceGuptaGitte> > -lopenblas*
17:32 < PrinceGuptaGitte> works, but no performace improvement :(
17:37 < Param-29Gitter[m> Which algorithm are you working on?
17:42 * Param-29Gitter[m sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/tApINVfBoEPOTYPxIuAgpgoy >
17:49 -!- favre49 [~favre49@106.51.29.244] has quit [Quit: leaving]
17:52 < PrinceGuptaGitte> yes
18:43 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/kfjaeizaiRLLnaqgyQuplnPP >
18:46 * hemal[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/lOlOKtcAyHRyCIvFkZNSnTwU >
19:06 * jeffin143[m] sent a long message: < https://matrix.org/_matrix/media/r0/download/matrix.org/EcnLuuDCvgCZLFtmEKGnXMqT >
19:06 < jeffin143[m]> Not sure go ahead and experiment
19:08 < hemal[m]> Ok, I would simply overload it for a while.
19:08 < hemal[m]> With minimal changes, and test.
19:13 < jeffin143[m]> Yrs
19:14 < jeffin143[m]> Yes
19:54 -!- ImQ009 [~ImQ009@unaffiliated/imq009] has quit [Quit: Leaving]
20:49 < PrinceGuptaGitte> Hello @zoq, did you get a chance to look at my gsoc proposal draft?
21:16 < rcurtin> ok, just opened #2326 to fix all the memory leak issues that I could find... took a while to handle all of those
22:58 -!- togo [~togo@2a02:6d40:34db:fd01:d1c3:9779:8ab4:3e07] has quit [Quit: Leaving]
22:59 < zoq> rcurtin: nice!
--- Log closed Mon Mar 23 00:00:40 2020